SEARCH · Engineering Papers

Results for “distributed parallel programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2015

The impact of aqueous medium on zeolite framework integrity

Understanding the zeolite framework stability in aqueous phase is crucial to develop stable catalysts. Al K–edge, extended X–ray absorption fine structure and 27Al MAS NMR spectroscopies in combination with DFT calculations have been used to monitor both qualitative and quantitative structural changes of two well–characterized samples with BEA structure. The effects of various properties on stability were explored, including Al concentration, Al distribution, particle size and structural defects. As the samples were degraded by treatment in hot liquid water, the local structure about the Al T–site remained mostly intact, including the Al–O–Si angles and bond distances, while the nano–scale crystalline structure as measured by XRD and TEM was disrupted. The combined data suggest a three–step mechanism in which, initially, the HBEA framework crystallinity decreases via hydrolysis of T–O bonds along polymorph stacking faults and inter–grain boundaries in a mode similar to crack propagation in glass. With prolonged exposure, amorphization occurs via hydrolysis of surface Si–OH groups propagating inward through the zeolite lattice. In parallel, cracks propagate within the crystalline micro–domains along paths through specific T–O–T groups. Authors thank B. W. Arey (PNNL) for HIM measurements, T. Huthwelker for support during Al XAFS measurements at the Swiss Light Source (PSI, Switzerland) and M. Y. Hu (PNNL) for support during NMR experiments. This work was supported by the U. S. Department of Energy (DOE), Office of Science, Office of Basic Energy Sciences, Division of Chemical Sciences, Geosciences & Biosciences. NMR experiments were performed at the Environmental Molecular Science Laboratory, a national scientific user facility sponsored by the DOE’s Office of Biological and Environmental Research, and Physical Science Laboratory both located at Pacific Northwest National Laboratory (PNNL). PNNL is a multi–program national laboratory operated for DOE by Battelle under Contract No. DE–AC05–76RL01830.

Environmental Molecular Sciences Laboratory↗

DOE OSTI2026

Microchannel-based Membrane-less Extraction of Li from Unconventional Lithium Sources & the Separation of REE

This final report provides an overview of the Project's entire duration, covering July 1, 2021 to December 31, 2023. It primarily focuses on the achievements, technological developments, and unique challenges the team faced while working on separating and extracting Lithium from produced waters. The project's primary aim was to create an integrated, high-throughput, membrane-less, and modular microfluidic platform that could extract Lithium from unconventional sources. We have successfully met all goals and milestones envisioned in the SOPO document. The most critical primary milestones, including the Go-No-Go milestone (refer to the Gantt chart in the Appendices), were successfully accomplished. We demonstrated phase separation (>90%) and extraction (>85%) performance in the MPSE using synthetic, and representative produced water composition feed at 50 ml/min total flow through MPSE 36. We have also performed a parametric study of the MPSE operations, beyond the scope of SOPO, exploring operating conditions of current and broader interest. The extended investigation of operational parameters is concurrent with our efforts to seek further development of the MPSE technology beyond the scope of the Project. Along these lines of development, we have made efforts to be responsive to DOE calls for technological developments of other types of resources (beyond PW) for the recovery of Critical Materials and higher TRL development (beyond TRL 4). During the work on this Project, we developed and implemented three innovative technical approaches that emerged from our efforts to successfully meet the Project milestones. The innovative & original technical approaches developed and implemented in this Project are now the contributions to process engineering that could be clearly credited to the Project. First, Convergent Design Approach is a comprehensive feedforward & feedback loop of four design phases: i) design for functionality, ii) design for manufacturing, iii) design for sustainability, and iv) design for market. Next was Process Intensification. A major aim of this Project was to create an innovative phase separation & extraction microscale-based technology for Li separation – thus the words microchannel-based in the Project title. A microscale-based technology is intrinsically in the center of the Process Intensification domain as defined by its unique principles. Therefore, Process Intensification was implicitly envisioned in the Project’s SOPO. Lastly, Time Scale Analysis is a novel tool for discovering the needs and directions of Process Intensification implementations in any process technology. This Project is fully credited for developing and implementing the three novel technical approaches mentioned above. These are general contributions to process engineering that emerged from this Project. Beyond the original SOPO scope, the OSU-U.Pitt research group utilized a Convergent Design methodology, integrating first-principles mathematical modeling with experimental validation on the Minimum Development Vehicle. By creating these Digital Twins, the team rapidly assessed manufacturing iterations to support TEA analysis. This framework further enabled the development of advanced Surface Modification Techniques, where hydrophobic and oleophobic coating strategies were optimized via Digital Twin tools and validated through rigorous 100-hour longevity testing. TEA Analysis: The closing efforts of this Project were focused on the TEA analysis. TEA analysis had two primary functions: i) enabling critical assessments of design variations withing 10 the Concurrent Design Approach, thus enabling evolution of the MPSE design to reach faster- better-cheaper alternatives; and ii) to create a bridge between the accomplishments of this Project and future projects of higher TRL, beyond TRL 6 level. It is important to note that the TEA model created in the Project stirred the technological solutions for the recovery of critical materials toward a vision of a very profitable modular plant that has unique zero-waste water discharge signature. More importantly, thanks to our experimental performance data and conservative assumptions, the TEA model predicts minimal technological and investment risks. Low cost of a modular unit of a nominal capacity of [1000 tons of Li 2 CO 3 /year] positions the MPSE based technology within the reach of community investors, thus offering a paradigm shift in the development of critical technologies. The project successfully navigated two primary challenges: solvent selection and manufacturing adaptation. Restricted by the SOPO to existing literature for lithium recovery, the team identified a critical need for a "material excellence program" to develop next-generation solvents, eventually concluding with a preliminary investigation into promising Ionic Liquids (ILs). Simultaneously, COVID-19 supply chain disruptions forced a pivot from traditional manufacturing to advanced additive methods at ATAMI-OSU. By transitioning from stainless steel to 3D-printed polymer substrates, the team achieved a transformative three-order-of- magnitude reduction in manufacturing costs and compressed prototyping timelines from several months to just two days. The MPSE technology offers significant energy, environmental, and economic advantages by overcoming the traditional bottlenecks of phase-separation hardware and contactor size. Unlike conventional mixer-settlers or membrane-based systems, MPSE operates without moving parts or fouling-prone membranes, achieving robust performance even with challenging, viscous, or particulate-heavy feeds. Key performance metrics include an energy intensity reduction of 5–50x (3–40 kJ/m 3 ) compared to incumbent technologies and a dramatic reduction of processing time to under 60 seconds, which drastically reduces the physical plant footprint. These technical efficiencies translate into superior economic outcomes; for a 100 t/year Li 2 CO 3 facility, implementing MPSE is projected to nearly halve contactor CAPEX (from $\$$6.08M to $\$$3.01M) and significantly increase the project's Net Present Value (NPV), derisking new investment and enabling distributed critical-mineral processing configurations. The commercialization of MPSE technology is being spearheaded by Vigsur Dynamics Inc., which has adopted a structured, parallel approach to technical and business development since its formation in January 2026. Following extensive customer discovery and engagement with the Oregon State University accelerator, Vigsur Dynamics is working to establish a business model that transitions from pilot demonstrations to modular hardware sales, ultimately aiming for a "build-own-operate" service strategy. Current technical milestones—including 100 hours of continuous operation, superior energy efficiency, and successful 6-unit modular scale-up— provide a foundation for this transition. Backed by ongoing IP licensing and a growing network of industrial and venture advisors, the company is actively de-risking the platform to replace conventional mixer-settler systems in the critical minerals market.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2013

Dynamic Line Rating Oncor Electric Delivery Smart Grid Program

Electric transmission lines are the lifeline of the electric utility industry, delivering its product from source to consumer. This critical infrastructure is often constrained such that there is inadequate capacity on existing transmission lines to efficiently deliver the power to meet demand in certain areas or to transport energy from high-generation areas to high-consumption regions. When this happens, the cost of the energy rises; more costly sources of power are used to meet the demand or the system operates less reliably. These economic impacts are known as congestion, and they can amount to substantial dollars for any time frame of reference: hour, day or year. There are several solutions to the transmission constraint problem, including: construction of new generation, construction of new transmission facilities, rebuilding and reconductoring of existing transmission assets, and Dynamic Line Rating (DLR). All of these options except DLR are capital intensive, have long lead times and often experience strong public and regulatory opposition. The Smart Grid Demonstration Program (SGDP) project co-funded by the Department of Energy (DOE) and Oncor Electric Delivery Company developed and deployed the most extensive and advanced DLR installation to demonstrate that DLR technology is capable of resolving many transmission capacity constraint problems with a system that is reliable, safe and very cost competitive. The SGDP DLR deployment is the first application of DLR technology to feed transmission line real-time dynamic ratings directly into the system operation’s State Estimator and load dispatch program, which optimizes the matching of generation with load demand on a security, reliability and economic basis. The integrated Dynamic Line Rating (iDLR)1 collects transmission line parameters at remote locations on the lines, calculates the real-time line rating based on the equivalent conductor temperature, ambient temperature and influence of wind and solar radiation on the stringing section, transmits the data to the Transmission Energy Management System, validates its integrity and passes it on to Oncor and ERCOT (Electric Reliability Council of Texas) respective system operations. The iDLR system is automatic and transparent to ERCOT System Operations, i.e., it operates in parallel with all other system status telemetry collected through Supervisory Control and Data Acquisition (SCADA) employed across the company.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

An Integrated View of Hydraulic Induced Fracture Geometry in Hydraulic Fracture Test Site 2

Until relatively recently, most of our understanding about the geometry of hydraulically induced fractures in unconventional reservoirs has been inferred by patterns observed via microseismic monitoring. Important information, such as fracture-azimuth, fracture-length, height-growth and other geometric data has been determined from microseismic “event clouds”, which in turn has been used to interpret a stimulated reservoir volume (SRV). It is important to note that relatively limited microseismic results have been acquired in conjunction with other diagnostics and validated in a consistent manner. The Hydraulic Fracture Test Site 2 (HFTS2) in the Permian Delaware Basin provides a unique opportunity to compare the frac geometry interpretations derived from multiple frac diagnostic tools and at multiple scales. The integrated view that emerges from all the frac diagnostic tools is that in HFTS2 the geometries of hydraulically induced fractures are not random and with a highly complex branching architecture. In fact, the fracs are mostly vertical, parallel plana domains, and both vertically and horizontally asymmetrical. The hydraulically induced fractures have a very consistent azimuth with a strike that matches SHmax. At the distance corresponding to the spacing between nearby wells in HFTS2, ~ 660 ft, the pattern of strain interceptions observed from Low Frequency Distributed Acoustic Sensing (LF-DAS) shows far-field dimensions that are consistent with the stage length dimensions at the stimulated well. In general, larger stages with higher number of clusters create larger number of interceptions and wider stimulated intervals than that of shorter stages with the same cluster to cluster spacing and fewer clusters. The hydraulically induced fractures also show a clear tendency to preferentially grow upwards as shown by the microseismic data, by the relative lower number of LF-DAS interceptions in nearby deeper wells and finally by the observed LF-DAS strain patterns in the vertical observation well. In the near field, the geometries of the fracture domains are also consistent. As shown by the distributed strain measurements obtained during production via the monitoring of Rayleigh Frequency Shift (RFS), each cluster has a separate, non-overlapping, frac-zone-domain that are generally centered around the locations of each perforation cluster. Overall, the hydraulically induced fractures in HFTS2 are interpreted as occurring in swarms associated with individual clusters, each with its own unique geometry but with similar predictable geometric and propagation tendencies. The comprehensive frac diagnostic program in HFTS2, the well-pad layout that permits the investigation of the Downloaded from http://onepetro.org/URTECONF/proceedings-pdf/21URTC/1-21URTC/D011S018R003/2477511/urtec-2021-5396-ms.pdf/1 by Carol Worster on 28 February 2022 URTeC 5396 2 impact that nearby producing wells has on frac geometry, together with an innovative Design of Experiment (DofE) that includes sequential-fracing, consistent cluster-to-cluster distances and few single-perforation cluster stages, has allowed us to gain a unique perspective about the geometry of the induced hydraulic fractures on this pad. Finally, the HFTS2 dataset has also provided us with a better understanding of the applicability and limitations of the different diagnostic tools.

58 GEOSCIENCES↗

DOE OSTI2015

Diagnosis of Performance Faults in LargeScale MPI Applications via Probabilistic Progress-Dependence Inference

Debugging large-scale parallel applications is challenging. Most existing techniques provide little information about failure root causes. Further, most debuggers significantly slow down program execution, and run sluggishly with massively parallel applications. This paper presents a novel technique that scalably infers the tasks in a parallel program on which a failure occurred, as well as the code in which it originated. Our technique combines scalable runtime analysis with static analysis to determine the least-progressed task(s) and to identify the code lines at which the failure arose. We present a novel algorithm that infers probabilistically progress dependence among MPI tasks using a globally constructed Markov model that represents tasks' control-flow behavior. In comparison to previous work, our algorithm infers more precisely the least-progressed task. Further, we combine this technique with static backward slicing analysis, further isolating the code responsible for the current state. A blind study demonstrates that our technique isolates the root cause of a concurrency bug in a molecular dynamics simulation, which only manifests itself at 7,996 tasks or more. We extensively evaluate fault coverage of our technique via fault injections in 10 HPC benchmarks and show that our analysis takes less than a few seconds on thousands of parallel tasks.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Using AI to Reproduce Neutrino Cross Section Analysis - Prototyping the Neutrino Discovery Platform

The Neutrino Discovery Platform (NDP) aims to accelerate DUNE-era science by making the neutrino program's existing datasets analyzable through fast, reproducible, and auditable workflows. We report a working version of two of its layers, data curation and agentic orchestration, built and tested end to end on MINERvA open data. The guiding lesson throughout is that a cross section is a measurement, and not just a plotted shape, only if it carries a defensible systematic-uncertainty budget, a trustworthy unfolding, and a reproducible record. Using a single medium-energy playlist pair from the MINERvA open-data release (about $2.05\times10^{17}$ protons on target of data), we first reproduced the shapes of two published charged-current inclusive $\nu_\mu$ measurements through a complete extraction ladder: selection, background subtraction, D'Agostini unfolding, efficiency correction, and flux normalization. These shape-level reproductions ran and tracked the published results, but they lacked the systematic-uncertainty machinery that defines a MINERvA cross section. To supply it, we vendored and built the MINERvA Analysis Toolkit and developed a many-universe systematic-uncertainty tool that produces a portable covariance artifact, a parallel event-loop runner, and a per-run auditability harness. Validated against a published covariance release, the toolchain reproduces the released statistical, flux, and muon-energy-scale terms and shows that they account for roughly 63\% of the total variance, with the remainder unreleased. Using this same infrastructure, we then performed a measurement of our own design, the hadronic recoil-energy distribution of low-energy ($E_\nu<2.5$~GeV) charged-current inclusive events, and found data/simulation shape agreement of $\chi^2/\mathrm{ndf}=1.26$. Together these results show that the platform supports original physics and not only reproductions.

Breaux, Auto [Tulane U. (main)]↗

DOE OSTI2026

Toward the Neutrino Discovery Platform: An Auditable, Uncertainty-Bearing Toolchain for MINERvA Open-Data Cross-Section Analysis

Breaux, Auto [Tulane U. (main)]↗

DOE OSTI2020

Scalable molecular dynamics on CPU and GPU architectures with NAMD

NAMD is a molecular dynamics program designed for high-performance simulations of very large biological objects on CPU- and GPU-based architectures. NAMD offers scalable performance on petascale parallel supercomputers consisting of hundreds of thousands of cores, as well as on inexpensive commodity clusters commonly found in academic environments. It is written in C++ and leans on Charm++ parallel objects for optimal performance on low-latency architectures. NAMD is a versatile, multipurpose code that gathers state-of-the-art algorithms to carry out simulations in apt thermodynamic ensembles, using the widely popular CHARMM, AMBER, OPLS, and GROMOS biomolecular force fields. Here, we review the main features of NAMD that allow both equilibrium and enhanced-sampling molecular dynamics simulations with numerical efficiency. We describe the underlying concepts utilized by NAMD and their implementation, most notably for handling long-range electrostatics; controlling the temperature, pressure, and pH; applying external potentials on tailored grids; leveraging massively parallel resources in multiple-copy simulations; and hybrid quantum-mechanical/molecular-mechanical descriptions. We detail the variety of options offered by NAMD for enhanced-sampling simulations aimed at determining free-energy differences of either alchemical or geometrical transformations and outline their applicability to specific problems. Last, we discuss the roadmap for the development of NAMD and our current efforts toward achieving optimal performance on GPU-based architectures, for pushing back the limitations that have prevented biologically realistic billion-atom objects to be fruitfully simulated, and for making large-scale simulations less expensive and easier to set up, run, and analyze. NAMD is distributed free of charge with its source code at www.ks.uiuc.edu.

high-performance computing↗

DOE OSTI2019

Mixed Integer Nonlinear Programming Approaches to Enhance Resiliency and Response Strategies in Critical Infrastructure

Motivation. Critical infrastructures are large, complex engineered systems that must be operated robustly under abnormal conditions resulting from natural hazards or intentional acts. For example, electric power systems must be robust to line faults, water utilities must rapidly mitigate contamination incidents, and computing networks must adapt to adversarial intrusions to protect critical information. Problem. It is difficult for decision-makers within resiliency analysis in critical infrastructure to optimize designs and develop effective response strategies that can account for uncertainties. Facing incomplete information and the sheer scope that a natural hazard or attack vector may incorporate, response can be ineffective without reliable, scalable decision support tools. These problems are intrinsically nonlinear and involve discrete decisions, and unfortunately, existing off-the-shelf mathematical programming methods cannot support optimization-based decision-making of these nonlinear at scale. Method/Approach and Results. This project emphasized development of fundamental optimization strategies that supported real- time mitigation and response for critical infrastructures. In particular, the project developed multi- tree approaches based on piecewise outer-approximations for solution of mixed-integer nonlinear programming (MINLP) problems. These techniques alternate between an MILP or MISOCP relaxation to obtain a lower bound and candidate discrete solutions and an NLP subproblem to obtain upper bounds. Using tailored relaxations based on problem structure, these methods were used to solve several key applications in resilience and response of critical infrastructure. This work resulted in two open-source, copyrighted software packages: CORAMIN (https://github.com/Coramin/Coramin) -- an object-oriented mathematical programming framework that supports tailored multi-tree algorithms for solution of large- scale mixed-integer nonlinear programming; and EGRET (Electrical Grid Research and Engineering Toolkit) (https://github.com/grid- parity-exchange/Egret) -- a declarative mathematical programming framework built upon CORAMIN and Pyomo for formulation and solution of resilience and operations problems in power grid systems. Furthermore, these tools resulted in several important published results, including the following: The first known global optimization approach that could solve the unit-commitment problem with nonlinear power flow constraints on medium-sized test problems; Improved parallel optimization-based bounds tightening and strengthening of relaxations of AC power flow constraints; and, Optimization-based approaches for improved grid resilience and use of demand response to improve grid resilience with reduction in capital requirements. Result Implications. This project developed first-of-a-kind algorithms for decision-making in critical infrastructure resilience operations and planning, as well as a next-generation toolkit for MINLP researchers. These approaches leveraged high-performance computing architectures to solve some of the largest, most challenging nonlinear discrete optimization problems to global optimality, and these successes were captured in open-source software to enable optimization-based decision-making, and efficient solution of MINLP formulations for electric power transmission grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2015

SU-E-T-75: A Simple Technique for Proton Beam Range Verification

Purpose: To develop a measurement-based technique to verify the range of proton beams for quality assurance (QA). Methods: We developed a simple technique to verify the proton beam range with in-house fabricated devices. Two separate devices were fabricated; a clear acrylic rectangular cuboid and a solid polyvinyl chloride (PVC) step wedge. For efficiency in our clinic, we used the rectangular cuboid for double scattering (DS) beams and the step wedge for pencil beam scanning (PBS) beams. These devices were added to our QA phantom to measure dose points along the distal fall-off region (between 80% and 20%) in addition to dose at mid-SOBP (spread out Bragg peak) using a two-dimensional parallel plate chamber array (MatriXX™, IBA Dosimetry, Schwarzenbruck, Germany). This method relies on the fact that the slope of the distal fall-off is linear and does not vary with small changes in energy. Using a multi-layer ionization chamber (Zebra™, IBA Dosimetry), percent depth dose (PDD) curves were measured for our standard daily QA beams. The range (energy) for each beam was then varied (i.e. ±2mm and ±5mm) and additional PDD curves were measured. The distal fall-off of all PDD curves was fit to a linear equation. The distal fall-off measured dose for a particular beam was used in our linear equation to determine the beam range. Results: The linear fit of the fall-off region for the PDD curves, when varying the range by a few millimeters for a specific QA beam, yielded identical slopes. The calculated range based on measured point dose(s) in the fall-off region using the slope resulted in agreement of ±1mm of the expected beam range. Conclusion: We developed a simple technique for accurately verifying the beam range for proton therapy QA programs.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

TU-AB-303-01: A Feasibility Study for Dynamic Adaptive Therapy of Non-Small Cell Lung Cancer

Purpose: To compare plans for NSCLC optimized using Dynamic Adaptive Therapy (DAT) with conventional IMRT optimization. DAT adapts plans based on changes in the target volume by using dynamic programing techniques to consider expected changes into the optimization process. Information gathered during treatment, e.g. from CBCT, is incorporated into the optimization. Methods and materials: DAT is formulated using stochastic control formalism, which minimizes the total expected number of tumor cells at the end of a treatment course subject to uncertainty inherent in the tumor response and organs-at-risk (OAR) dose constraints. This formulation allows for non-stationary dose distribution as well as non-stationary fractional dose as needed to achieve a series of optimal plans that are conformal to tumor over time. Sixteen phantom cases with various sizes and locations of tumors, and OAR geometries were generated. Each case was planned with DAT and conventional IMRT (60Gy/30fx). Tumor volume change over time was obtained by using, daily MVCT-based, two-level cell population model. Monte Carlo simulations have been performed for each treatment course to account for uncertainty in tumor response. Same OAR dose constraints were applied for both methods. The frequency of plan modification was varied to 1, 2, 5 (weekly), and 29 (daily). The final average tumor dose and OAR doses have been compared to quantify the potential benefit of DAT. Results: The average tumor max, min, mean, and D95 resulted from DAT were 124.0–125.2%, 102.1–114.7%, 113.7–123.4%, and 102.0–115.9% (range dependent on the frequency of plan modification) of those from conventional IMRT. Cord max, esophagus max, lung mean, heart mean, and unspecified tissue D05 resulted from AT were 84–102.4%, 99.8–106.9%, 66.9–85.6%, 58.2–78.8%, and 85.2–94.0% of those from conventional IMRT. Conclusions: Significant tumor dose increase and OAR dose reduction, especially with parallel OAR with mean or dose-volume constraints, can be achieved using DAT.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2013

Massively parallel implementations of coupled-cluster methods for electron spin resonance spectra. I. Isotropic hyperfine coupling tensors in large radicals

Coupled cluster (CC) methods provide highly accurate predictions of molecular properties, but their high computational cost has precluded their routine application to large systems. Fortunately, recent computational developments in the ACES III program by the Bartlett group [the OED/ERD atomic integral package, the super instruction processor, and the super instruction architecture language] permit overcoming that limitation by providing a framework for massively parallel CC implementations. In that scheme, we are further extending those parallel CC efforts to systematically predict the three main electron spin resonance (ESR) tensors (A-, g-, and D-tensors) to be reported in a series of papers. In this paper inaugurating that series, we report our new ACES III parallel capabilities that calculate isotropic hyperfine coupling constants in 38 neutral, cationic, and anionic radicals that include the {sup 11}B, {sup 17}O, {sup 9}Be, {sup 19}F, {sup 1}H, {sup 13}C, {sup 35}Cl, {sup 33}S,{sup 14}N, {sup 31}P, and {sup 67}Zn nuclei. Present parallel calculations are conducted at the Hartree-Fock (HF), second-order many-body perturbation theory [MBPT(2)], CC singles and doubles (CCSD), and CCSD with perturbative triples [CCSD(T)] levels using Roos augmented double- and triple-zeta atomic natural orbitals basis sets. HF results consistently overestimate isotropic hyperfine coupling constants. However, inclusion of electron correlation effects in the simplest way via MBPT(2) provides significant improvements in the predictions, but not without occasional failures. In contrast, CCSD results are consistently in very good agreement with experimental results. Inclusion of perturbative triples to CCSD via CCSD(T) leads to small improvements in the predictions, which might not compensate for the extra computational effort at a non-iterative N{sup 7}-scaling in CCSD(T). The importance of these accurate computations of isotropic hyperfine coupling constants to elucidate experimental ESR spectra, to interpret spin-density distributions, and to characterize and identify radical species is illustrated with our results from large organic radicals. Those include species relevant for organic chemistry, petroleum industry, and biochemistry, such as the cyclo-hexyl, 1-adamatyl, and Zn-porphycene anion radicals, inter alia.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗

DOE OSTI2018

Major improvements on the longwave radiative interactions between surface and clouds in the Polar Regions in atmospheric global circulation model (GCM). Final Project Report

1. Summary of Work and Accomplishments in Year 1 (01/15/2015-01/14/2016). We developed new ice cloud parameterizations based on state-of-the-art MODIS Collection 6 (MC6) ice particle model. Features of the model include the consideration of surface roughness of ice crystals and spectral consistency in cloud property retrievals. Using more than 14,000 particle size distributions (PSDs) from in-situ measurements and the latest ice particle single-scattering property library, our parameterizations provide band-averaged bulk-scattering properties. According to statistics of fittings, the parameterization schemes represent the band-averaged bulk-scattering properties very well. Compared to the ice particle model developed by Fu (1998), flux simulations with the MC6 particle model result in larger upward flux at the top of the atmosphere (TOA) and smaller at the surface for typical cirrus clouds. In the assessment of the effect of longwave light scattering, our results also support the conclusions of previous studies. The error in flux calculations reaches about 10 W/m 2 when a cirrus cloud is thin and its particle size is small. 2. Summary of Work and Accomplishments in Year 2 (01/15/2016-01/14/2017) Clouds are a major modulator of the global radiation budgets. However, representations of clouds in general circulation models (GCMs) neglect many important processes, particularly those related to ice clouds. One major uncertainty source is the radiative transfer scheme in GCMs. To reduce the computational burden in most GCMs, absorption is the only radiative transfer process considered in longwave spectral bands. Recently, a state-of-the-art MC6 ice model has been available, which provides spectral consistency in ice cloud retrievals. With an advanced light scattering library for ice particles, we performed sensitivity studies of the potential impacts on the climate including light scattering for MC6 model and other 11 ice cloud models. Specifically, we modified RRTMG_LW (the GCM version of Longwave Rapid Radiative Transfer Model), a radiative transfer module widely used in GCMs and numerical prediction models, to identify flux simulation differences with and without considering light scattering processes. The simulations with light scattering come from a rigorous radiative solver, DISORT (Discrete Ordinates Radiative Transfer Program for a Multi-Layered Plane-Parallel Medium), are used as benchmarks. The results show that the weighted annual mean biases of RRTMG_LW for the upward flux at the top of the atmosphere, the downward flux at the surface, and the net flux into the atmosphere are about 0.8 ± 0.3, -0.1 ± 0.05, and -0.7 ± 0.3 W m-2, respectively. According to the different the ice crystal shapes, the weighted annual mean bias for heating rate is about -0.006 ± 0.02 to 0.04 K/day. 3. Summary of Work and Accomplishments in Year 3 (01/15/2017-01/14/2018) Since absorption dominates optical properties of clouds in the longwave (LW) spectrum, most of general circulation models (GCMs) only take absorption properties of clouds into account in the radiative transfer modules in order to reduce computational costs. To quantify the biases of excluding LW scattering when clouds exist, we simulated fluxes and heating rates by using satellite data from Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO), CloudSat, Clouds and the Earth’s Radiant Energy System (CERES) and Moderate Resolution Imaging Spectrometer (MODIS) merged products (CCCM) in 2010. In annual global average, neglecting LW scattering causes overestimation by 2.6 W/m 2 for the top-of-atmosphere (TOA) upward fluxes and underestimation by 1.2 W/m 2 for surface downward fluxes. In particular, regional extreme biases are approximately 12 W/m 2 for TOA upward fluxes and are approximately -3.6 W/m 2 for surface downward fluxes, or are approximately 5% of the global averaged outgoing longwave radiation (OLR) and 1% of the global averaged surface downward fluxes, respectively. In terms of heating rates, on average, LW scattering heats the whole atmosphere column by 0.0045 K/day, heats the cloud layers by 0.0420 K/day, heats the surface by 0.028 K/day, and cools the tropopause by 0.018 K/day.

58 GEOSCIENCES↗

DOE OSTI2016

A feasibility study of dynamic adaptive radiotherapy for nonsmall cell lung cancer

Purpose: The final state of the tumor at the end of a radiotherapy course is dependent on the doses given in each fraction during the treatment course. This study investigates the feasibility of using dynamic adaptive radiotherapy (DART) in treating lung cancers assuming CBCT is available to observe midtreatment tumor states. DART adapts treatment plans using a dynamic programming technique to consider the expected changes of the tumor in the optimization process. Methods: DART is constructed using a stochastic control formalism framework. It minimizes the total expected number of tumor cells at the end of a treatment course, which is equivalent to maximizing tumor control probability, subject to the uncertainty inherent in the tumor response. This formulation allows for nonstationary dose distributions as well as nonstationary fractional doses as needed to achieve a series of optimal plans that are conformal to the tumor over time, i.e., spatiotemporally optimal plans. Sixteen phantom cases with various sizes and locations of tumors and organs-at-risk (OAR) were generated using in-house software. Each case was planned with DART and conventional IMRT prescribing 60 Gy in 30 fractions. The observations of the change in the tumor volume over a treatment course were simulated using a two-level cell population model. Monte Carlo simulations of the treatment course for each case were run to account for uncertainty in the tumor response. The same OAR dose constraints were applied for both methods. The frequency of replanning was varied between 1, 2, 5 (weekly), and 29 times (daily). The final average tumor dose and OAR doses have been compared to quantify the potential dosimetric benefits of DART. Results: The average tumor max, min, mean, and D95 doses using DART relative to these using conventional IMRT were 124.0%–125.2%, 102.1%–114.7%, 113.7%–123.4%, and 102.0%–115.9% (range dependent on the frequency of replanning). The average relative maximum doses for the cord and esophagus, mean doses for the heart and lungs, and D05 for the unspecified tissue resulting 84%–102.4%, 99.8%–106.9%, 66.9%–85.6%, 58.2%–78.8%, and 85.2%–94.0%, respectively. Conclusions: It is feasible to apply DART to the treatment of NSCLC using CBCT to observe the midtreatment tumor state. Potential increases in the tumor dose and reductions in the OAR dose, particularly for parallel OARs with mean or dose–volume constraints, could be achieved using DART compared to nonadaptive IMRT.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2015

Current Status of Human Resource Training Program for Fostering RIBiomics Professionals

RI-Biomics is a state-of-the-art radiation fusion technology for evaluating in-vivo dynamics such as absorption, distribution, metabolism and excretion (ADME) of new drug candidates and biomaterials using radioisotope (RI), and quantitative evaluation of their efficacy via molecular imaging techniques and animal models. The RI-Biomics center is the sole comprehensive research and experiment complex in Korea that can simultaneously perform the radio-synthesis of drug candidate with radioisotope, analysis, and molecular imaging evaluation with animal model. Molecular imaging techniques, including nuclear imaging (SPECT and PET), near-infrared fluorescent (NIRF) imaging, and magnetic resonance imaging (MRI), are the cutting-edge technologies for evaluating drug candidates. Since they allow in vivo real-time imaging of the diseased site, monitoring the biodistribution of drug and determining the optimal therapeutic efficacy following treatments, we have integrated RI-ADME and molecular imaging to provide useful information for drug evaluation and to accelerate the development of new drugs and biomaterials. The RI-Biomics center was established with total investment of 18 million $ during four years from 2009 to 2012 in order to develop a comprehensive analyzing system using RI for new drug development as an axis for national growth in the next generation. The RI-Biomics center has labeling synthesis facility for the radiosynthesis of drug candidate with radioisotope such as Tc-99m, I-125, I-131, F-18, H-3 and C-14 using hot cell. It also includes RI-general analysis facilities, such as Radio-HPLC, LC/MS, GC/MS, gamma counter that can analyzing the radio-synthesized materials, and animal image analysis facilities that developed small animal imaging equipment such as SPECT/PET/CT, 7 T MRI, in-vivo optical imaging system and others. In order to achieve the system to verify safety and effectiveness of the new drugs using RI, it is necessary to establish a human resource training program for fostering RI-Biomics professionals in the following key fields; (1) Radio-pharmaceuticals synthesis and labeled compound development, (2) Development of RI-ADME in the living object and image assessment technology. Personnel training program that carries out theoretical education and practical training in the field related to RI-Biomics in parallel is being conducted. Internship training for university students has been administered twice already while educational program for the existing professionals in the RI-Biomics field will be carried out during the summer of 2014. The human resource training program for combination of RIADME and different molecular imaging techniques can offer synergistic advantages to facilitate understanding RIADME and fostering RI-ADME professionals. (authors)

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2016

Association Mapping of Cell Wall Synthesis Regulatory Genes and Cell Wall Quality in Switchgrass

Inefficient conversion of biomass to biofuels is one of the main barriers for biofuel production from such materials. Approximately half of polysaccharides in biomass remain unused by typical biochemical conversion methods. Conversion efficiency is influenced by the composition and structure of cell walls of biomass. Grasses such as wheat, maize, and rice, as well as dedicated perennial bioenergy crops, like switchgrass, make up ~55% of biomass that can be produced in the United States. Grass cell walls have a different composition and patterning compared with dicotyledonous plants, including the well-studied model plant, Arabidopsis. This project identified genetic determinants of cell wall composition in grasses using both naturally occurring genetic variation of switchgrass and gene network reconstruction and functional assays in rice. In addition, the project linked functional data in rice and other species to switchgrass improvement efforts through curation of the most abundant class of regulators in the switchgrass genome. Characterizing natural diversity of switchgrass for variation in cell wall composition and properties, also known as quality, provides an unbiased avenue for identifying biologically viable diversity in switchgrass cell walls. To characterizing natural diversity, this project generated cell wall composition and enzymatic deconstruction data for ~450 genotypes of the Switchgrass Southern Association Collection (SSAC), a diverse collection composed of 36 switchgrass accessions from the southern U.S. distribution of switchgrass. Comparing these data with other measures of cell wall quality for the same samples demonstrated the complementary nature of the diverse characterization platforms now being used for biomass characterization. Association of the composition data with ~3.2K single nucleotide variant markers identified six significant single nucleotide variant markers co-associated with digestibility and another compositional trait. These markers might be used to select switchgrass genotypes with improved composition in breeding programs for biofuel and forage production. Because the SSAC continues to be characterized by collaborators in the bioenergy community, the data generated will be used to identify additional markers in higher resolution genotyping data to approach identifying the genes and alleles that cause natural variation in switchgrass cell wall quality. For example, these markers can be surveyed in the 2100-member Oklahoma Southern and Northern Lowland switchgrass collections that this project also characterized. An orthogonal approach to biodiversity studies, using comparative functional genomics permits systematic querying of how much regulatory information is likely to be transferable from dicots to grasses and use of accumulated functional genomics resources for better-characterized grass species, such as rice, itself a biomass source in global agriculture and in certain regions. The project generated and tested a number of specific hypotheses regarding cell wall transcription factors and enzymes of grasses. To aid identification of cell wall regulators, the project assembled a novel, highdepth and -quality gene association network using a general linearized model scoring system to combine rice gene network data. Using known or putative orthologs of Arabidopsis cell wall biosynthesis genes and regulators, the project pulled from this network a cell wall sub-network that includes 96 transcription factors. Reverse genetics of a co-ortholog of the Arabidopsis MYB61 transcription factor in rice revealed that this regulatory node has evolved the ability to regulate grass-specific cell wall synthesis enzymes. A transcription factor with such activity has not been previously characterized to our knowledge, representing a major conclusion of this work. Changes in gene expression in a protoplast-based assay demonstrated positive or negative roles in cell wall regulation for eleven other transcription factors from the rice gene network. Eight of fifteen (53%) of these have not previously been examined for this function. Some of these may represent novel grass-diverged cell wall regulators, while others are likely to have this function across angiosperms. A parallel effort of this project to expand knowledge of enzymes that have evolved to function in grass cell wall synthesis, revealed that a grass-diverged enzyme in rice, OsAT 5 , ferulates monolignols that are naturally incorporated into grass cell walls. This finding opens potential natural selection avenues for improving biomass composition for downstream processing by weak base pretreatment. Thus, this project has significantly expanded knowledge of cell wall synthesis and regulation in rice, information that can be used in reverse genetics and synthetic biology approaches to re-engineer cell walls for improved production of biofuel and high-value products. To lay the foundation for translating these results directly for switchgrass improvement, the project employed a comparative phylogenetic analysis of the major group of cell wall transcription factors that have been found to function in cell wall regulation, the R 2 R 3 MYBs. This analysis concluded that known cell wall regulators are largely conserved across switchgrass, rice, maize, poplar, and Arabidopsis. This interpretation is also largely consistent with the gene network analysis described above, though both approaches provide evidence that some co-orthologs of Arabidopsis regulators have diminished or increased in importance based on gene expression patterns. Also, several clades containing dicot cell wall regulators have expanded, consistent with the evolution of new cell wall regulators. This latter result is supported by functional analysis of the R 2 R 3 MYB protein SWAM 1 in a collaboration between this project and the DOE-funded group of Dr. S. Hazen at the University of Massachusettes. The curation of the switchgrass genome through this project provides specific targets for future engineering of switchgrass cell wall regulation and may also facilitate identification of regulators that underlie the molecular markers that are genetically linked to differences in cell wall quality. With the goal of spurring further research and technological developments in lignocellulosic biofuel production, this work has been communicated to the bioenergy and cell wall communities though various presentations and publications. To date, three manuscripts have been published, two others are near to publication, three others are in an advanced state, and two to four more are likely to be written based on analyses still in progress. In addition, project participants have presented thirteen posters and talks at regional, national, and international meetings about aspects of this project. In sum, the work supported by this funding has made and communicated significant progress in identifying the genes that grasses use for cell wall synthesis and regulation, information that will be used by project participants and others to improve the efficiency of conversion of lignocellulosic biomass to biofuels.

09 BIOMASS FUELS↗

DOE OSTI2014

Evaluation of Low Power ARM Processors for Monte Carlo Particle Transport: MCNP6 on the ARM Cortex-A8 - Paper 83

In the push towards exascale computing, the limiting factors are power requirements and heat dissipation. Using current technology, the power required to drive an exascale supercomputer would near 400-MW. Clearly, future computing hardware will have to be more energy efficient in order to achieve exascale performance. Most of the current research in advanced computing architectures is in the use of standard CPUs with accelerators. However, these accelerators are not generally supported by the traditional scientific programming languages (C, C++, and Fortran) and the scientific software must be tailored specifically to take advantage of the accelerators. Large scale scientific software (hundreds-of-thousand to millions of lines of code) can not be easily ported to the computing platform du jour. The widespread use of low power ARM based processors in the mobile computing market offer a low power alternative to accelerators that are also supported by the traditional scientific programming languages and programming paradigms such as MPI and OpenMP. Computing architectures for scientific computing are often assessed using standard benchmarks such as LINPACK benchmark or using suites of mini-applications that are greatly simplified stand-ins for scientific software. Often the real applications that will deployed on the scientific supercomputers are not ported or tested until delivery of the machines. In order to evaluate the use of ARM processors for scientific computing the Monte Carlo particle transport code, MCNP version 6 was compiled on the ARM Cortex-A8 and a set of benchmark problems were used to assess performance in comparison to an Intel Xeon E5-2670 and the low power Intel Atom N270. MCNP is a continuous energy Monte Carlo particle transport code in development at Los Alamos National Laboratory since 1977. MCNP is used to transport neutrons, photon, electrons, and charged particles using continuous energy interaction data. It is commonly used in fields of nuclear power, nuclear medicine, radiation protection, and high-energy physics through-out the world. MCNP version 6 is approximately 450 thousand lines of code, written primary in Fortran90, with some C and C++. MCNP supports distributed multiprocessing using MPI and threading with OpenMP. The ARM Cortex-A8 executes MCNP6 using about twice as much power as the Intel Xeon E5-2670 and about the same amount of power as the Intel Atom N270. However, these results are encouraging for the use of low-power ARM chips in future supercomputers. The ARM Cortex-A8 is a 32-bit CPU and it's NEON general-purpose SIMD (single-instruction multiple data) engine does not support double-precision floating-point arithmetic. More recent ARM processors (ARM Cortex-A53 and Cortex-A57) support 64-bit addressing and have NEON co-processors that support double-precision floating-point arithmetic. ARM claims that the A50 series delivers a performance increase of 15 times the Cortex-A8 performance for similar power usage. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗