Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Enabling Scalable and Extensible Memory-mapped Datastores in Userspace

Exascale workloads are expected to incorporate data-intensive processing in close coordination with traditional physics simulations. These emerging scientific, data-analytics and machine learning applications need to access a wide variety of datastores in flat files and structured databases. Programmer productivity is greatly enhanced by mapping datastores into the application process's virtual memory space to provide a unified “in-memory” interface. Currently, memory mapping is provided by system software primarily designed for generality and reliability. However, scalability at high concurrency is a formidable challenge on exascale systems. Also, there is a need for extensibility to support new datastores potentially requiring HPC data transfer services. In this article, we present UMap , a scalable and extensible userspace service for memory-mapping datastores. Furthermore, through decoupled queue management, concurrency aware adaptation, and dynamic load balancing, UMap enables application performance to scale even at high concurrency. We evaluate UMap in data-intensive applications, including sorting, graph traversal, database operations, and metagenomic analytics. Our results show that UMap as a userspace service outperforms an optimized kernel-based service across a wide range of intra-node concurrency by 1.22-1.9 × . We performed two case studies to demonstrate UMap 's extensibility. First, a new datastore residing in remote memory is incorporated into UMap as an application-specific plugin. Second, we present a persistent memory allocator Metall built atop UMap for unified storage/memory.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Precursor Analysis Report: Cyber Attack on Thyssenkrupp Blast Furnace 2014

The Cyber Attack on Thyssenkrupp Blast Furnace 2014 Precursor Analysis Report leverages publicly available information about the Thyssenkrupp Steel Mill cyber attack and catalogs anomalous observables for each technique employed in the attack. This analysis is based upon the methodology of the Cybersecurity for the Operational Technology Environment (CyOTE) program. In December 2014, the German Government’s Federal Office for Information Security (BSI) released a report detailing a cyber attack on a German steel mill that occurred earlier that year, though exact dates and details of the attack were not revealed. While the report did not specify the name of the company, multiple sources identified the victim as one of Europe’s largest steel manufacturers, Thyssenkrupp AG. Further, Thyssenkrupp announced on 16 May of that year that Europe’s largest blast furnace, “Schwelgern 2,” located at its facility in Duisburg, Germany, would be offline for several weeks for repairs and upgrades, suggesting Schwelgern 2 was likely the target of the attack. The attack began in early 2014, when adversaries infiltrated the victim steel mill’s Information Technology (IT) network via a spearphishing campaign, then worked their way into the Operational Technology (OT) environment, where they executed software that caused denial of service, denial of control, and eventually a loss of control. This led to the blast furnace shutting down without proper safety procedures, resulting in catastrophic physical damage. No lives were lost in the incident, but ThyssenKrupp suffered $4 million in damage to the blast furnace and an additional $6 million in lost revenue. The adversaries required specialized knowledge and expertise in steel production, which enabled them to compromise a variety of internal systems and components across both IT and OT networks. The attack also demonstrated detailed knowledge of the industrial control systems (ICS) and production processes being used. This combination resulted in one of the earliest known publicly reported cybersecurity incidents resulting in physical damage to ICS equipment. Researchers and analysts identified 19 unique techniques (used in a sequence of 20 steps) utilized during the attack with a total of 454 observables using MITRE ATT&CK® for Industrial Control Systems. The CyOTE program assesses observables accompanying techniques used prior to the triggering event to identify opportunities to detect malicious activity. If observables accompanying the attack techniques are perceived and investigated prior to the triggering event, earlier comprehension of malicious activity can take place. Fifteen of the identified techniques used during the Thyssenkrupp cyber attack were precursors to the triggering event. Analysis identified 369 observables associated with these precursor techniques, 316 of which were assessed to have an increased likelihood of being perceived in the 120 days preceding the triggering event. The response and comprehension time could have been reduced if the observables had been identified earlier. The information gathered in this report contributes to a library of observables tied to a repository of artifacts, data sources, and technique detection references for practitioners and developers to support the comprehension of indicators of attack. Asset owners and operators can use these products if they experience similar observables or to prepare for comparable scenarios.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2020

Validation of SAS4A/SASSYS-1 for Steady-State Single-Phase Natural Circulation

The development of numerical software for engineering applications requires the validation of the code against experimental benchmark datasets. To support the validation of SAS4A/SASSYS-1 in simulating the single-phase natural circulation within nuclear reactor systems, high-precision steady-state experiments are performed to capture single-phase natural circulation phenomena on an existing scaled facility with comprehensive instrumentation. Forced convection tests are designed precisely capturing the facility’s critical thermal-hydraulic parameters required for one-dimensional modeling, and a comprehensive single-phase natural circulation dataset is obtained with well-documented experimental uncertainty and facility description. Analysis and discussion based on the finalized dataset confirm the dataset’s ability in capturing dominant phenomena and address important physical interpretation of parameters. The dataset reported in this project provides a valuable benchmark resource for the validation of system analysis codes under single-phase natural circulation inside nuclear reactors. Validation of SAS4A/SASSYS-1 is then performed against the obtained benchmark dataset to confirm the capability of its physics model in simulating the steady-state single-phase natural circulation. The experimental facility is modeled in the candidate code. Solution verification is performed using Richardson-extrapolation-based estimators to quantify and restrict numerical errors from discretization. Numerical uncertainty originating from finite maximum pseudo-transient time is also quantified and restricted. Input uncertainty provided by the benchmark dataset is forward propagated through the candidate code, directly quantifying the simulation output in a Monte Carlo approach. The composition of the output uncertainty is further determined by the estimators of Sobol’ indices through a variance-based sensitivity analysis. With uncertainty quantified for each individual condition, detailed comparison between the simulation results and experimental data is performed covering the whole dataset, which shows consistent agreement for all important quantities. The validation activity reported in this project demonstrates that SAS4A/SASSYS-1 can predict the primary parameters with satisfactorily accuracy under steady-state single-phase natural circulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Risk-based area of review estimation in overpressured reservoirs to support injection well storage facility permit requirements for CO 2 storage projects

This paper by the Energy & Environmental Research Center presents a workflow and modeling approach for delineating a risk-based area of review (AOR) to support a U.S. Environmental Protection Agency (EPA) Class VI permit for a carbon dioxide (CO 2 ) storage project. The approach combines semianalytical solutions for estimating formation fluid leakage through a hypothetical leaky wellbore with the results of numerical reservoir simulations to define the AOR. The modeling utilizes 1) semianalytical solutions from the peer-reviewed literature for formation fluid leakage through abandoned wellbores by Raven (1990) and Avci (1994), 2) a FORTRAN model compiled and described in Cihan et al. (2011, 2012) called ASLMA (Analytical Solution for Leakage in Multilayered Aquifers), and 3) a computational framework for estimating a risk-based AOR first proposed by Oldenburg et al. (2014, 2016). Therefore, the approach builds upon well-established research and underlying hydrogeological principles that have been upheld for nearly three decades. Moreover, the ASLMA model has been broadly applied to an array of storage projects. The work presented herein extends these earlier works using a custom wrapper written in the software environment, R (R Core Team, 2020), which was developed to perform multiple runs of the ASLMA model using given ranges for one or more input parameters. In addition, the current work simulates the pressure buildup within the storage reservoir in response to CO 2 injection using a compositional simulator to better accommodate the temporospatial evolution of pressure buildup within the storage reservoir that is more accurately modeled using a heterogeneous geologic model and a compositional simulator that accounts for the multiphase interactions. The workflow is demonstrated using a case study for a 180,000-metric-ton-per-year storage project located in the PCOR (Plains CO 2 Reduction) Partnership region. For the storage project evaluated here, under the scenario where the leaky wellbore is open to a saline aquifer (thief zone) between the overlying seal (cap rock) and the underground sources of drinking water (USDW), the risk-based AOR essentially collapses to the areal extent of the CO 2 plume in the storage reservoir because the pressure buildup in the storage reservoir beyond the CO 2 plume is insufficient to drive formation fluids up a hypothetical leaky wellbore into the USDW. However, even under the conservative assumption that the leaky wellbore is not open to a thief zone, beyond the areal extent of the CO 2 plume, the incremental leakage is less than 400 m 3 over 20 years, which represents ~0.0001% or less of the total volume of water contained within the USDW rock volume. As discussed in the text, the threshold criterion for defining the risk-based AOR is site-specific and should be informed by the results of the sensitivity analysis and available site characterization data. The approach outlined in this paper is designed to be protective of USDWs and, therefore, comply with the Safe Drinking Water Act requirements and provisions for the U.S. EPA Class VI Underground Injection Control (UIC) Program (Class VI Rule) and North Dakota Administrative Code Chapter 43-05-01.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Tractometry of the Human Connectome Project: resources and insights

The Human Connectome Project (HCP) has become a keystone dataset in human neuroscience, with a plethora of important applications in advancing brain imaging methods and an understanding of the human brain. We focused on tractometry of HCP diffusion-weighted MRI (dMRI) data. We used an open-source software library (pyAFQ; https://yeatmanlab.github.io/pyAFQ) to perform probabilistic tractography and delineate the major white matter pathways in the HCP subjects that have a complete dMRI acquisition (n = 1,041). We used diffusion kurtosis imaging (DKI) to model white matter microstructure in each voxel of the white matter, and extracted tract profiles of DKI-derived tissue properties along the length of the tracts. We explored the empirical properties of the data: first, we assessed the heritability of DKI tissue properties using the known genetic linkage of the large number of twin pairs sampled in HCP. Second, we tested the ability of tractometry to serve as the basis for predictive models of individual characteristics (e.g., age, crystallized/fluid intelligence, reading ability, etc.), compared to local connectome features. To facilitate the exploration of the dataset we created a new web-based visualization tool and use this tool to visualize the data in the HCP tractometry dataset. Finally, we used the HCP dataset as a test-bed for a new technological innovation: the TRX file-format for representation of dMRI-based streamlines. We released the processing outputs and tract profiles as a publicly available data resource through the AWS Open Data program's Open Neurodata repository. We found heritability as high as 0.9 for DKI-based metrics in some brain pathways. We also found that tractometry extracts as much useful information about individual differences as the local connectome method. We released a new web-based visualization tool for tractometry—“Tractoscope” (https://nrdg.github.io/tractoscope). We found that the TRX files require considerably less disk space-a crucial attribute for large datasets like HCP. In addition, TRX incorporates a specification for grouping streamlines, further simplifying tractometry analysis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Atacama Cosmology Telescope: Combined kinematic and thermal Sunyaev-Zel’dovich measurements from BOSS CMASS and LOWZ halos

The scattering of cosmic microwave background (CMB) photons off the free-electron gas in galaxies and clusters leaves detectable imprints on high resolution CMB maps: the thermal and kinematic Sunyaev-Zel’dovich effects (tSZ and kSZ respectively). We use combined microwave maps from the Atacama Cosmology Telescope DR5 and Planck in combination with the CMASS (mean redshift $\langle z \rangle$ = 0.55 and host halo mass $\langle M_{vir} \rangle$ = 3 × 10 13 M ⊙ ) and LOWZ ( $\langle z \rangle$ = 0.31 , $\langle M_{vir} \rangle$ = 5 × 10 13 M ⊙ ) galaxy catalogs from the Baryon Oscillation Spectroscopic Survey (BOSS DR10 and DR12), to study the gas associated with these galaxy groups. Using individual reconstructed velocities, we perform a stacking analysis and reject the no-kSZ hypothesis at 6.5σ, the highest significance to date. This directly translates into a measurement of the electron number density profile, and thus of the gas density profile. Despite the limited signal to noise, the measurement shows at high significance that the gas density profile is more extended than the dark matter density profile, for any reasonable baryon abundance (formally > 90 σ for the cosmic baryon abundance). We simultaneously measure the tSZ signal, i.e., the electron thermal pressure profile of the same CMASS objects, and reject the no-tSZ hypothesis at 10σ. We combine tSZ and kSZ measurements to estimate the electron temperature to 20% precision in several aperture bins, and find it comparable to the virial temperature. In a companion paper, we analyze these measurements to constrain the gas thermodynamics and the properties of feedback inside galaxy groups. We present the corresponding LOWZ measurements in this paper, ruling out a null kSZ (tSZ) signal at 2.9 (13.9) σ , and leave their interpretation to future work. This paper and the companion paper demonstrate that current CMB experiments can detect and resolve gas profiles in low mass halos and at high redshifts, which are the most sensitive to feedback in galaxy formation and the most difficult to measure any other way. They will be a crucial input to cosmological hydrodynamical simulations, thus improving our understanding of galaxy formation. These precise gas profiles are already sufficient to reduce the main limiting theoretical systematic in galaxy-galaxy lensing: baryonic uncertainties. Future such measurements will thus unleash the statistical power of weak lensing from the Rubin, Euclid and Roman observatories. Finally, our stacking software ThumbStackis publicly available and directly applicable to future Simons Observatory and CMB-S4 data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Towards Low-Overhead Resilience for Data Parallel Deep Learning

Data parallel techniques have been widely adopted both in academia and industry as a tool to enable scalable training of deep learning models. At scale, DL training jobs can fail due to software or hardware bugs, may need to be preempted or terminated due to unexpected events, or may perform suboptimally because they were misconfigured. Under such circumstances, there is a need to recover and/or reconfigure data-parallel DL training jobs on-the-fly, while minimizing the impact on the accuracy of the DNN model and the runtime overhead. In this regard, state-of-art techniques adopted by the HPC community mostly rely on checkpoint-restart, which inevitably leads to loss of progress, thus increasing the runtime overhead. In this paper we explore alternative techniques that exploit the properties of modern deep learning frameworks (overlapping of gradient averaging and weight updates with local gradient computations through pipeline parallelism) to reduce the overhead of resilience/elasticity. To this end we introduce a failure simulation framework and two resilience strategies (immediate mini-batch rollback and lossy forward recovery), which we study compared with checkpoint-restart approaches in a variety of settings in order to understand the trade-offs between the accuracy loss of the DNN model and the runtime overhead.

data-parallel training↗
DOE OSTI2020

Gaussian Process Optimization of Sensitivity-Based Similarity Metrics between New Nuclear Applications and New/Existing Benchmarks [Slides]

This presentation discusses Nuclear Criticality Safety (NCS) and how designing safe, new nuclear criticality experiments requires expert judgement, which could take years of experience. Sensitivity/uncertainty (S/U) analysis can be utilized by less experienced individuals to conservatively estimate uncertainties in important parameters, such as k eff , in newly proposed nuclear experiments. The presentation poses the question of how this analysis can be performed and states that the answer lies in matching new nuclear experiments with existing benchmark experiments using similarity metrics. By increasing the criticality safety of the application in this work, higher mass limits could be used in PF-4 operations. Additionally, the presentation discusses MCNP6.2®, Whisper-1.1, the software that can be used in this analysis. Also discussed is the fact that International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks rarely match new nuclear applications and that there are significant differences in given set of materials and/or geometry. If there are no benchmarks that match the application, the presentation discusses the possibility of creating new benchmarks. In conclusion, this work presents a Gaussian process (GP) optimization scheme that was used to generate new benchmarks with the highest sensitivity-based similarity metrics to user-defined nuclear applications. The Gaussian process optimization successfully designed 3 new experimental benchmarks that were highly correlated to the application of interest and had k eff values near critical. Optimization over c k,i-r has shown that investigating specific isotope reactions for different applications is crucial to designing benchmark experiments. Partial contribution from Pu dominates c k similarity metric. Future work includes testing new stand-alone similarity metrics or new combinations of similarity metrics as the design criterion of this optimization – design criterion is application dependent.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Probabilistic Multi-Hazard Performance Assessment of Concrete Structures in Nuclear Installations

Concrete structures in nuclear installations are subject to time-dependent degradation mechanisms that can deteriorate their physical and mechanical properties, potentially exacerbating the risk of structural failure under external forces such as a seismic event. Previous research has extensively investigated the seismic response of nuclear concrete structures and the associated risk, as well as their effect on structural components safety margins. However, substantial work is still necessary to incorporate concrete aging effects into such evaluations. In fact, most models in the literature assume pristine concrete conditions and do not account for the impact of aging on the structural components’ fragility curves. This work identifies relevant time-dependent degradation mechanisms and provides simplified models to predict the the evolution of key material properties based on data from the literature. Namely, this work focuses on the aging effects of corrosion, alkali–silica reaction (ASR), and irradiation on reinforced concrete within US Department of Energy (DOE) nuclear facilities and nuclear power plants (NPP) structures. Furthermore, degradation models based on literature data are presented that define the relationship between probabilistic material properties and the concrete’s age. In this work, sampled material properties served as input for a simplified finite element model (FEM) of a critical nuclear structural system, with the output of the FEM being the seismic response for a given ground motion. The results of the FEM were then used within a probabilistic performance assessment with a statistically significant number of samples. The research presented herein addresses the detrimental effects of hazards caused by natural phenomena on deteriorated concrete elements of nuclear installations. This work directly benefits the safety analysis performed on US DOE/ National Nuclear Security Administration (NNSA) nuclear facilities located in areas prone to seismic activity. The results presented herein could aid in the improvement of DOE-STD-1020, the DOE Standard that addresses seismic risk analysis and capacity evaluation in DOE facilities. DOE-STD-1020 refers to the requirements in American Society of Civil Engineers (ASCE) 4-98, now superseded by ASCE 4-16, that shall be met in performing dynamic response analyses and generating in-structure response spectra, provided that such requirements are consistent with the requirements of ASCE/Structural Engineering Institute (SEI) 43-05. Moreover, the results presented herein could also aid in the updating of section C3.1.1. of ASCE 4-16 to account for the effects of aging on the stiffness of reinforced elements and American Concrete Institute (ACI) 349.3R-18, “Report on Evaluation and Repair of Existing Nuclear Safety-Related Concrete Structures.” Ultimately, this work can assist the risk assessment of potential lifetime extension of the existing US commercial nuclear fleet (light water reactors) and the safety analysis of the emerging advanced nuclear reactors. The proposed proof-of-concept methodology employs open-source DOE computational tools and is transferable to commercial software commonly used by engineering firms.

42 ENGINEERING↗
DOE OSTI2026

Software Control Program For Transportable Microgrid State-of-charge Balancing And Frequency Stability Controls

A deterministic state-of-charge (SOC) balancing approach software control code is introduced as an integral secondary management to primary control layer of an islanded small microgrid or nanogrid system made up of multiple grid-forming inverter/battery/solar combination systems, where each set of batteries with each inverter are on independent DC buses (i.e. non-paralleled on the DC sides). A DERMS-level control approach, algorithm and automation controller program was developed to improve coordination and enable microgrid asset compliance and SOC balancing, enabling provision of a system-level power stability support architecture, load support, and asset scalability. The architecture is configured to treat each unit or micro/nano-grid as a node in a microgrid network, allowing for autonomous DERMS control regarding load and SOC balancing and power stability. As the network grows with the addition of units, greater coordination efforts may be required. The ideal small network microgrid ranges from 2-10 inverter/battery units before additional control parameters must be considered in the existing architecture. The control approach focuses on a deterministic state-of-charge analysis as the primary level control process followed by a secondary control loop using a forced frequency-watt droop strategy to conform off-the-shelf components into behaving under a leader-follower configuration. Adopting this control scheme has been shown to allow for a balanced, unit-coordinated microgrid network, enabling stable power flow. The deterministic state-of-charge approach is introduced as an integral primary control layer of an islanded small network microgrid. A standard strategy for SOC balancing is implementing a battery management system (BMS) to control SOC on the DC side. An alternative approach is to determine how to coordinate sending and receiving power on the AC side with multiple units. The latter approach assesses all the integrated units in the microgrid network. Once the individual units are identified, further system data is required to calculate each unit's total kWh, provided information about its capability to supply or consume kWh and availability. The secondary control layer in the multi-layered small network microgrid methodology uses the primary layer’s decision to initiate frequency setpoint changes, initializing the SOC balancing. The secondary control layer considers numerous system-dependent variables to enable a charging and discharging profile based on adjustable frequency setpoints. The combined architecture will result in stable, coordinated power flow enhancing an AC microgrid's functionalities.

Myers, KurtS [Idaho National Laboratory (INL), Ida↗
DOE OSTI2023

Guided construction of single cell reference for human and mouse lung

Accurate cell type identification is a key and rate-limiting step in single-cell data analysis. Single-cell references with comprehensive cell types, reproducible and functionally validated cell identities, and common nomenclatures are much needed by the research community for automated cell type annotation, data integration, and data sharing. Here, we develop a computational pipeline utilizing the LungMAP CellCards as a dictionary to consolidate single-cell transcriptomic datasets of 104 human lungs and 17 mouse lung samples to construct LungMAP single-cell reference (CellRef) for both normal human and mouse lungs. CellRefs define 48 human and 40 mouse lung cell types catalogued from diverse anatomic locations and developmental time points. We demonstrate the accuracy and stability of LungMAP CellRefs and their utility for automated cell type annotation of both normal and diseased lungs using multiple independent methods and testing data. We develop user-friendly web interfaces for easy access and maximal utilization of the LungMAP CellRefs.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Hybrid Analytics Solution to Improve Coal Power Plant Operations

This project focused on developing advanced methods for thermal performance monitoring of a coal-fueled power plant. The specific goal was to develop and demonstrate a new thermal performance monitoring approach using a hybrid model that integrates a physics-based heat balance model with a machine learning-based pattern recognition model. The hybrid model enables increased accuracy and scope of the thermal analysis and an improved ability to monitor and detect changes in plant operation. This new approach takes full advantage of the individual model capabilities and creates an important new set of capabilities not previously possible using the two types of models separately. Using the heat balance model, a rich set of derived parameters (virtual sensors) are calculated from the measured plant operating data at each time point. The combined measured and derived data values are used by machine learning algorithms to create pattern recognition models over the range of normal unit operation. To create the monitoring models, historical data from normal operation of the plant is first processed by the heat balance model to compute the derived parameter data. The result is a greatly expanded set of normal operating data that can be used as input to create the pattern recognition model. Once the models are calibrated for normal operation, the hybrid model is suitable for use in continuous online monitoring. During online monitoring, new plant operating data is processed first by the heat balance model and then by the pattern recognition model. Results from the pattern recognition model quantify the deviation of each measured or derived parameter from its expected value in normal operation. The hybrid models can detect abnormal changes in plant operating data with very high accuracy and sensitivity. When abnormal behavior is detected, alerts are generated automatically for evaluation by the plant monitoring staff. The new hybrid solution product was developed and verified in the performance of the project. The hybrid solution was tested first in a simulation environment that mimicked the plant data systems and infrastructure used by U.S. power generating plants and utilities. The hybrid solution was then deployed for real-time, online monitoring of an operating coal-fueled power plant at a field test site. Field testing demonstrated that all hybrid solution development objectives were accomplished. The project work was based on combining the capabilities of two existing software products to create the new hybrid solution product. One of these was the existing MapEx® heat balance product and the other was the existing SureSense® advanced pattern recognition product. Each of these separate products was assessed to be at a Technology Readiness Level (TRL) of 9 at the start of the effort. The hybrid solution product was assessed to be at a TRL of 2 at the start of the project based on early feasibility work by the project team. At completion of the field testing performed in the project, the hybrid solution product was assessed to be at a TRL of 7. The project team expects that the hybrid solution product will be deployed commercially and will achieve a TRL of 9 within one year after completion of the project.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2020

On the Marriage of Asynchronous Many Task Runtimes and Big Data: A Glance

The rise of the accelerator-based architectures and reconfigurable computing have showcased the weakness of software stack toolchains that still maintain a static view of the hardware instead of relying on a symbiotic relationship between static (e.g., compilers) and dynamic tools (e.g., runtimes). In the past decades, this need has given rise to adaptive runtimes with increasingly finer computational tasks. These finer tasks help to take advantage of the hardware by switching out when a long latency operation is encountered (because of the deeper memory hierarchies and new memory technologies that might target streaming instead of random access), thus trading off idle time for unrelated work. Examples of these finer task runtimes are Asynchronous Many Task (AMT) runtimes, in which highly efficient computational graphs run on a variety of hardware. Due to its inherent latency tolerant characteristics, Latency-sensitive applications, such as Graph Analytics and Big Data can effectively use these runtimes. This paper aims to present an example of how the careful design of an AMT can exploit the hardware substrate when faced with high latency applications such as the ones given in the Big Data domain. Moreover, with its introspection and adaptive capabilities, we aim to show the power of these runtimes when facing the changing requirements of the application workloads. We use the Performance Open Community Runtime (P-OCR) as our vehicle to demonstrate the concepts presented here.

adaptive runtime, big data analysis↗
DOE OSTI2025

MOOSE ProbML: Parallelizable Probabilistic Machine Learning and Uncertainty Quantification Capabilities

The Multiphysics Object Oriented Simulation Environment (MOOSE) is a widely used open- source finite element software for performing multiphysics multiscale simulations in a massively parallel fashion. Recently, the computational team at Idaho National Laboratory (INL) has implemented Probabilistic Machine Learning (ProbML) capabilities in MOOSE—in a parallelized fashion—and enable active learning with large-scale computational models for tasks such as surrogate model development, scale bridging, forward/inverse uncertainty quantification (UQ), Bayesian optimization, etc. This presentation summarizes these developments in MOOSE along with demonstrations on several real applications relevant to nuclear energy. At the fundamental level, samplers like Monte Carlo/Latin Hypercube, variance reduction, parallelized Markov Chain Monte Carlo (MCMC) support uncertainty propagation in both forward and inverse settings. These samplers can be integrated with the Gaussian processes (GP) suite in MOOSE, which offer several variants like scalar GPs, multi-output GPs, and deep GPs, to enable active learning. These GPs can be tuned using gradient-based optimization methods like Adam and its variants or gradient-free methods like the elliptical slice sampler (a variant of MCMC adept under Gaussian settings) for more complex covariance kernels or likelihoods whose gradient computations can be cumbersome. A variety of batch acquisition functions permit parallelized evaluation of the computational model and support different learning objectives with high efficiency like Bayesian inference, global surrogate development, optimization, etc. Furthermore, libtorch integration supports training, evaluation, and re-training of neural networks and other complex machine learning models in active learning settings. The impacts of these developments are shown on several real applications: (1) nuclear fuel inverse UQ and model inadequacy assessment using the Kennedy O’Hagan framework; (2) uncertainty aware surrogate modeling for additive manufacturing to predict field quantities; (3) nuclear reactor rare events analysis; and (4) complex fluid flow prediction using a global surrogate with quantified prediction uncertainty. Finally, the outlook of MOOSE ProbML is discussed for both outer-loop and inner-loop computations in the broad view to accelerate fuels and materials qualification, address gaps in knowledge and data, and assess new reactor/fuel systems.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Empirically Driven multiwavelength K-c orrections at low redshift

K -corrections – a necessary ingredient for converting between flux in observed bands to flux in rest-frame bands – are critical for comparing galaxies at differing redshifts. These corrections often rely on fits to empirical or theoretical spectral energy distribution (SED) templates of galaxies. However, templates can only produce reliable K-corrections in regimes where SED models are robust. For instance, the templates utilized in some popular software packages are not well-constrained in some bands (e.g. WISE W4 in KCORRECT ), which results in ill-behaved K -corrections. We address this shortcoming by developing an empirically driven approach to K -corrections that limits the dependence on SED templates. We perform a polynomial fit for the K -correction as a function of a galaxy’s rest-frame colour determined in a pair of well-constrained bands (e.g. 0 (g − r)) and redshift, exploiting the fact that galaxy SEDs can be approximated as a one-parameter family at low redshift. For bands well-constrained by SED templates, our empirically driven K -corrections yield results comparable to the SED fitting methods used by KCORRECT and the GSWLC-M2 catalogue (the updated medium-deep GALEX–SDSS–WISE Legacy Catalogue). However, our method dramatically outperforms Kcorrect derived K -corrections for WISE W4 . Our method is also robust to incorrect template assumptions outside of the optical bands and enforces that the K -correction must be zero at z = 0. Our K -corrected photometry and code are publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Robust Distributed State Estimator for Interconnected Transmission and Distribution Networks (Final Report RPPR-1)

This project’s objective is to develop a combined transmission and distribution state estimator which accounts for very large system size and model complexity (by way of distributing the computations) and large number of solar PV units connected to the distribution system on multiple feeders. The project not only provides a robust formulation and solution to this problem but also tests the solution by implementing it on a well-established large utility system. It introduces several improvements with respect to the state of the art in existing state estimation software: (a) The developed state estimator (SE) allows robust and accurate monitoring of bidirectional flows in distribution systems which result due to the distributed energy sources which are not observable and thus not incorporated in generation dispatch; (b) Large utility systems with tens of thousands of transmission buses and hundreds of thousands of distribution nodes are difficult to model as a single integrated system. This shortcoming is addressed by developing a “scalable distributed computational framework” which allows splitting the ultra large system models into several small subsystems and coordinating their solution by a robust and practical state estimation formulation; (c) Measurement errors irrespective of their locations are detected and removed by the developed state estimator. Historically, transmission and distribution systems were analyzed and operated as two independent systems. Given the non-transposed short feeder sections, unevenly loaded phases, strictly radial configuration and unidirectional power flows in the absence of remote generation, distribution system analysis was customized to account for these characteristics. However, some of these assumptions are no longer valid (non-radial configuration, bidirectional power flows) and thus distribution system analysis should be revisited. Furthermore, in the past, the interaction between the transmission and distribution systems was quite passive, where distribution substations were modeled as lumped loads in the transmission system model. With substantial generation injected by renewable generation located in the distribution systems, such modeling will no longer be accurate. The developed state estimator facilitates proper monitoring of the interactions between the transmission and distribution systems and enables smart dispatch of these units which are made observable by the state estimator.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Integrate FARM with PID controllers: IES Simulation Ecosystem Control System Development

The FARM (Feasible Actuator Range Modifier) software module is a component of the RAVEN-based FORCE framework for analysis of Integrated Energy Systems (IES). FARM was designed to support the HERON software module in the solution of the optimal dispatch problem for IES units. As the result of HERON-FARM dispatch simulation, the set-point trajectories are optimized to meet constraints on both the production variables (i.e., the variables to be optimized such as the electrical power, the hydrogen production rate, etc.) and the process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.) at a coarse time resolution (every 10 or 100 seconds) over long time horizons (several days or weeks). In case the operational constraints need to be met at finer time resolution, the computational burden of HERON-FARM would linearly increase with the sampling rate, and sub-optimal solutions might be obtained. System responses characterized by overshoots and damped oscillations temporarily violating the imposed constraints might occur during abrupt power transients. In this report, a hierarchical control system architecture for the operation of the Dynamic Energy Technology and Integration Laboratory (DETAIL) facility constructed at INL was proposed. First, the preliminary studies on the proposed control strategy for operating the facility and the designed PI controllers were reviewed. In particular, the current approach for generating the set-point trajectories was studied, and its limits were identified. To this aim, the inclusion of a Supervisory Control layer embedding a modified version of the FARM algorithm for preserving the system safe operation over both long and real-time horizons was proposed. In this way, FARM would be applied twice, i.e., the original version (“FARM Validator”) aiding the solution of the power dispatch problem, and the modified version (“FARM Supervisory” coordinating the PI controllers to address the real-time control tasks. Despite the kernel of the two modules is the same algorithm, their roles, tasks, and capabilities are quite different. A detailed description of the role of FARM at addressing low-level control tasks is provided, along with tentative operational procedures for training the models embedded into the algorithm by using the collected experimental data.

42 ENGINEERING↗
DOE OSTI2020

waveSZ: A Hardware-Algorithm Co-Design of Efficient Lossy Compression for Scientific Data

Error-bounded lossy compression is critical to the success of extreme-scale scientific research because of ever-increasing volumes of data produced by today's high-performance computing (HPC) applications. Not only can error-controlled lossy compressors significantly reduce the I/O and storage burden but they can retain high data fidelity for post analysis. Existing state-of-the-art lossy compressors, however, generally suffer from relatively low compression and decompression throughput (up to hundreds of megabytes per second on a single CPU core), which considerably restrict the adoption of lossy compression by many HPC applications especially those with a fairly high data production rate. In this paper, we propose a highly efficient lossy compression approach based on field programmable gate arrays (FPGAs) under the state-of-the-art lossy compression model SZ. Our contributions are fourfold. (1) We adopt a wavefront memory layout to alleviate the data dependency during the prediction for higher-dimensional predictors, such as the Lorenzo predictor. (2) We propose a co-design framework named WAVESZ based on the wavefront memory layout and the characteristics of SZ algorithm and carefully implement it by using high-level synthesis. (3) We propose a hardware-algorithm co-optimization method to improve the performance. (4) We evaluate our proposed WAVESZ on three real-world HPC simulation datasets from the Scientific Data Reduction Benchmarks and compare it with other state-of-the-art methods on both CPUs and FPGAs. Experiments show that our WAVESZ can improve SZ's compression throughput by 6.9x similar to 8.7x over the production version running on a state-of-the-art CPU and improve the compression ratio and throughput by 2.1x and 5.8x on average, respectively, respectively, compared with the state-of-the-art FPGA design.

Compression Ratio↗