Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “IMPLEMENTATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Pantex Plant Ogallala Aquifer and Perched Groundwater Contingency Plan

The Pantex Plant Ogallala Aquifer and Perched Groundwater Contingency Plan has been developed in accordance with the requirements identified in the: • Interagency Agreement for the Pantex Superfund Site, Article 8.5 Work to be Performed, • Compliance Plan Provision of Hazardous Waste Permit No. 50284, and • Record of Decision for Groundwater, Soil, and Associated Media, Pantex Plant. A Long‐Term Monitoring System Design has been designed to monitor conditions in the perched groundwater including changes in the perched aquifer as a result of implementing the response actions. Monitoring is required for verifying the effectiveness of perched groundwater response actions (i.e., conditions in the perched aquifer are being affected as intended) and for confirming that the perched aquifer and Ogallala Aquifer characterization as defined in the Resource Conservation and Recovery Act Facility Investigation Report and the Corrective Measure Studies/Feasibility Study remains accurate. If monitoring results obtained through the monitoring network identify an unexpected condition or deviation, contingent actions will be considered and implemented as necessary to ensure continued protection of the Ogallala Aquifer and human health and the environment. Potential deviations to expected technology performance may be encountered for each of the four primary response actions that compose the selected remedy for perched groundwater; Playa 1 Pump and Treat System, Southeast Area Pump and Treat System, Southeast Area In‐Situ Bioremediation System (comprised of the Southeast In‐Situ Bioremediation System Original System, Southeast Area In‐Situ Bioremediation System Extension System, Offsite In‐Situ Bioremediation System, Perchlorate/Chromium ISB, Northeast ISB and County Road 8 ISB), and Zone 11 In‐Situ Bioremediation System. Monitoring will also be conducted to determine if there are deviations to the expected characterization, e.g., contaminants not expected as a result of the RCRA Facility Investigation characterization. Deviations to expected conditions in the Ogallala Aquifer could also be encountered if the response actions in the perched groundwater are not performing as expected, i.e., preventing contaminants from migrating to the Ogallala Aquifer. Currently, Pantex has begun investigation of detections of high explosives above groundwater protection standards in wells on the Texas Tech University property and a plume that is moving to the northeast from that area. Due to those detections, this Plan recognizes the fact that future detections in the Ogallala will be focused on first‐ time detections of analytes. After a remedy is determined, this Plan will require modification to address-deviations and contingent actions. This Plan was developed to identify the contingent actions necessary to mitigate impacts resulting from deviations to site conditions or response action performance. The Plan defines the environmental problem being addressed by the response actions, clarifies the expected conditions and objectives of the response actions, and identifies the potential deviations to the response actions (due to site conditions or technology performance) that could be encountered. The deviations were evaluated to determine the likelihood of occurrence, potential impact, and time to respond to avoid impact. The Plan also identifies the monitoring outlined in the Long‐Term Monitoring System Design Report (Consolidated Nuclear Security, 2024) and Sampling Analysis Plan (PanTeXas Deterrence, 2024) that will be used to detect the deviations. Lastly, the Plan specifies the contingent actions that could be implemented in response to the deviations. Because each response focuses on a discrete portion of the perched aquifer and contaminant plume, each response action has a different set of expected conditions, and therefore differing impacts from deviations to the site and technology expectations. As a result, the contingent actions are identified for each response action and potential deviation including specific constituents, location, and conditions. If deviations are encountered that impact the ability of the response action to meet performance objectives, the contingent actions will be focused on ensuring the response action can meet the performance objective. Contingent actions may be implemented as interim actions (ISMs/removal actions) in accordance with the Record of Decision, Interagency Agreement, and Hazardous Waste Permit‐50284, if warranted by the specific circumstances. For deviations to site characterization expected conditions, the contingent action will focus on determination of the source of the deviation, determination of the appropriate response, and evaluation of additional work to be completed. However, if the deviation to characterization impacts the performance of the response action, the contingent action will again focus on ensuring performance objectives can be met. Early source term removals and cleanup actions have been implemented to protect the Ogallala Aquifer. Because of these actions and based on modeling results, the expected conditions in the Ogallala Aquifer are that constituents of concern will not be detected above the Groundwater Protection Standards (GWPSs) nor will they reach potential points of exposure above the GWPS. The primary deviation of concern for the Ogallala is if constituents are detected in the Ogallala Aquifer near or above GWPSs. If it occurs, this change in expected conditions would require further evaluation of site and contaminant characteristics to determine an appropriate course of action. The evaluation would include additional monitoring, source identification, implementation of interim protective measures (if necessary), and delineation of extent. These evaluations are necessary to determine an appropriate response action for the Ogallala. The primary goal of the Plan is to provide for the continued protection of the Ogallala Aquifer and the health of its consumers. In recognition, this Plan presents a flexible and rational approach for making future decisions associated with confirming the change in perched and Ogallala aquifer conditions and identifying a response (technical activities, changes to response actions, regulatory oversight, and public involvement).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

FPGA-accelerated SpeckleNN with SNL for real-time X-ray single-particle imaging

We present the implementation of a specialized version of our previously published unified embedding model, SpeckleNN, for real-time speckle pattern classification in X-ray Single-Particle Imaging (SPI), using the SLAC Neural Network Library (SNL) on an FPGA platform. This hardware realization transitions SpeckleNN from a prototypic model into a practical edge solution, optimized for running inference near the detector in high-throughput X-ray free-electron laser (XFEL) facilities, such as those found at the Linac Coherent Light Source (LCLS). To address the resource constraints inherent in FPGAs, we developed a more specialized version of SpeckleNN. The original model, which was designed for broader classification across multiple biological samples, comprised ~5.6 million parameters. The new implementation, while reducing the parameter count to 64.6K (a 98.8% reduction), focuses on maintaining the model's essential functionality for real-time operation, achieving an accuracy of 90%. Furthermore, we compressed the latent space from 128 to 50 dimensions. This implementation was demonstrated on the KCU1500 FPGA board, utilizing 71% of available DSPs, 75% of LUTs, and 48% of FFs, with an average power consumption of 9.4W according to the Vivado post-implementation report. The FPGA performed inference on a single image with a latency of 45.015 microseconds at a 200 MHz clock rate. In comparison, running the same inference on an NVIDIA A100 GPU resulted in an average power consumption of ~73W and an image processing latency of around 400 microseconds. Our FPGA-accelerated version of SpeckleNN demonstrated significant improvements, achieving an 8.9 × speedup and a 7.8 × reduction in power consumption compared to the GPU implementation. Key advancements include model specialization and dynamic weight loading through SNL, which eliminates the need for time-consuming FPGA design re-synthesis, allowing fast and continuous deployment of models (re)trained online. These innovations enable real-time adaptive classification and efficient vetoing of speckle patterns, making SpeckleNN more suited for deployment in XFEL facilities. This implementation has the potential to significantly accelerate SPI experiments and enhance adaptability to evolving experimental conditions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Predicting the Impact of Utility Lighting Rebate Programs on Promoting Industrial Energy Efficiency: A Machine Learning Approach

Implementation costs are a major factor in manufacturers’ decisions to invest in energy-efficient technologies. Emerging technologies in lighting systems, however, typically require small investment costs and offer short, simple payback periods, due, in part, to federal, state, and utility incentive programs. Recently, however, certain state and federal mandates have reduced the support for and efficacy of electricity utility incentivizing programs. To determine the impact of such support programs, this study examined historical data regarding lighting retrofit savings, implementation costs, and utility rebates gathered from 13 years of industrial energy audits by a U.S. Department of Energy Industrial Assessment Center in a midwestern state. It uses a machine learning approach to evaluate the industrial energy and cost-saving opportunities that may have been lost due to decisions attributable to legislative mandates, utility policies, and manufacturers’ calculations and to evaluate the potential effect of lighting rebates on manufacturers’ decisions to implement industrial energy-efficient lighting retrofits. The results indicate that the decision not to implement lighting energy efficiency recommendations resulted in a loss of more than USD800,000 in potential rebates by industries during the study period and that the implementation of lighting energy assessment recommendations could have increased by about 50% if electric utility rebates had been available. These findings can help industries evaluate the benefits of implementing lighting efficiency improvements, and help utilities determine feasible lighting retrofit rebate values for incentivizing such changes by the industries they serve.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Adaptive Fault Detection Based on Neural Networks and Multiple Sampling Points for Distribution Networks and Microgrids

Smart networks such as microgrid (MG) and active distribution networks (ADN) have been recently playing an important role in power system operation. The design and implementation of appropriate protection systems for such networks must be addressed, which imposes new technical challenges. This paper presents the implementation and validation aspects of an adaptive fault detection strategy based on neural networks (NNs) and multiple sampling points for ADN and MG. The solution is implemented on an edge device. Artificial NNs are used to derive a data-driven model that uses only local measurements to detect fault states of the network without the need for communication infrastructure. Multiple sampling points are used to derive a data-driven model, which allows the generalization considering the implementation in physical systems. The adaptive fault detector model is implemented on a Jetson Nano system, which is a single-board computer (SBC) with a small Graphic Processing Unit (GPU) intended to run machine learning loads at the edge. The proposed method is tested in a physical, real-life, low-voltage network located at Universidad del Norte, Colombia. This testing network is based on the IEEE-13 Node Test Feeder scaled down to 220 V. The validation in a simulation environment shows the accuracy and dependability above 99.6%, while the real-time tests show the accuracy and dependability of 95.5% and 100%, respectively. Without hard-to-derive parameters, the easy-to-implement embedded model highlights the potential for real-life applications.

42 ENGINEERING↗
DOE OSTI2020

Subtask 1.3 – Integrated Carbon Capture and Storage for North Dakota Ethanol Production

The Energy & Environmental Research Center (EERC), in partnership with Red Trail Energy, LLC (RTE), a North Dakota ethanol producer; the North Dakota Industrial Commission (NDIC) Renewable Energy Program (REP); and the U.S. Department of Energy (DOE), conducted a feasibility and implementation study for a commercial carbon capture and storage (CCS) effort. This subtask provided technical support and developed recommended practices of how small-scale industrial CO2 emitters (<1,000,000 tonnes of CO2 emitted annually) may economically deploy CCS. The 64-million-gallon dry mill RTE ethanol facility, emitting an average 180,000 tonnes of CO2 annually, was the subject of the case study. The positive outcome of this research, which shows technical and economic potential for ethanol–CCS in North Dakota, has resulted in RTE acquiring an approved Permit to Drill on December 2, 2019, for a stratigraphic test well in early 2020, a necessary step toward a North Dakota CO2 Storage Facility Permit (SFP) for the RTE CCS effort. Outcomes include 1) validating the Broom Creek Formation as a regional target for CCS, 2) determining the full carbon life cycle of an industrial fuel production facility with CCS, 3) developing a field implementation plan (FIP) for small-scale CCS, and 4) determining the validity and pathway for using CCS to meet low-carbon fuel (LCF) standards. The technical team included the EERC, RTE, Trimeric Corporation, Schlumberger Carbon Services, and Computer Modelling Group (CMG). Findings from activities conducted November 2016 – May 2020 are summarized as follows. Several key steps have been accomplished toward validating the Broom Creek Formation as a CO2 injection and storage target at the RTE CCS site, including verification of the presence and structure of sandstone layers that may comprise the potential CO2 storage reservoir and the several thousand feet of overlying confining zone. Work included site characterization using existing data, interpretation of seismic data within the study area, and geologic modeling simulation of CO2 injection. Interpreted results estimate 3000 feet of confining zone between the Broom Creek Formation (storage target) and the lowermost underground source of drinking water (e.g., the Fox Hills Formation). The thickness of the Broom Creek injection target varies 230–420 ft within the survey area. Results were used to inform the location of a stratigraphic test well and associated characterization test program. No impediments were identified within the targeted CO2 storage complex that would prevent the project from moving forward. A stratigraphic test well is the next step to validate these results and to acquire remaining data necessary to develop a North Dakota CO2 SFP application. The EERC generated full carbon life cycle estimates for CCS integration with the RTE ethanol facility. Results indicated that an average 40% reduction in CO2 emissions is possible through CCS implementation. Approximately half of the carbon in the overall life cycle for a dry mill ethanol plant is generated through the fermentation process and emitted to the atmosphere; this is the CO2 stream targeted for CCS. The remaining carbon is attributed to corn feedstock farming (diesel, fertilizer), energy for fuel processing (natural gas, electricity), and transportation (diesel) of the fuel product. Life cycle carbon estimates are also affected by the anticipated energy consumption of a potential capture facility, which depend on the type of CO2 product generated. For example, a 30%–40% net CO2 emission reduction is estimated if a liquefied CO2 facility were incorporated compared to a 40%–50% net CO2 reduction if a supercritical “injection-grade” CO2 product is generated; i.e., more energy is required to further refine the CO2 stream, affecting the full carbon life cycle estimates. A CCS FIP was developed and initiated at the RTE CCS site, resulting in the development of several guidance documents: a CO2 Capture Process Design Package, a North Dakota CO2 geologic Storage Permits Template, and a Public Outreach Package for CCS in North Dakota. General FIP components include CO2 capture system, pipeline and well designs; monitoring, verification, and accounting (MVA) plans; geologic characterization and testing programs; and permitting and outreach plans. Vendor bids were also acquired for the CO2 liquefaction facility. Near-surface characterization (groundwater and soil gas sampling) and geologic characterization (seismic survey) were initiated to inform development of a UIC Class VI-compliant MVA plan compliant with a North Dakota CO2 SFP. Designs (well and geologic testing) were completed for a stratigraphic test well compliant with a North Dakota CO2 SFP. In addition, the outreach plan was executed, including community open houses, meetings with city/county/state officials, and development of public materials. Although other entities continued to mature incentive programs in 2019–2020, California and the Internal Revenue Service (IRS) currently provide the most advanced economic opportunities for CCS integrated with fuel production. The California Low-Carbon Fuel Standard (LCFS) adopted a CCS Protocol in January 2019, allowing submittal of a design-based pathway (DBP) application for an approved temporary (not certified) carbon intensity value for a fully engineered facility. An ethanol–CCS DBP application to the California LCFS Program (officially approved February 28, 2020) was developed to show that the RTE CCS effort meets LCFS requirements. The approved DBP provides confidence to advance the project and supports potential investments. Other entities continue to mature incentive programs. The IRS issued guidance in February 2020 that addresses the definition of beginning of construction and revenue procedure on partnerships for the Enhancement of Carbon Dioxide Sequestration Credit (a.k.a. Section 45Q) CCS tax credit program; the IRS anticipates issuing further guidance on issues such as secure geologic storage, utilization qualifications, and recapture of claimed credits. Maturing incentive programs coupled with workable permitting regulations provide confidence to advance CCS projects in North Dakota and support financial investment to proceed with designing, constructing, and implementing CCS projects at small-scale fuel production facilities. The largest hurdles for CCS implementation at small-scale industrial systems are often business/economic-related (i.e., not technical). Market uncertainty already exists for agriculture-based alternative fuels such as corn ethanol, for which production has increased by ~33%, and prices have correspondingly lowered since 2015. Passing the Section 45Q tax credit program improves economic feasibility for CCS but may require external investors for a small business to achieve maximum benefits. Public–private partnerships with NDIC and DOE have resulted in foundational technical and regulatory knowledge, growing stakeholder confidence, and a pathway to implementation that enables similar industrial CCS projects in the region to advance. This subtask was funded through the EERC–DOE Joint Program on Research and Development for Fossil Energy-Related Resources Cooperative Agreement No. DE-FE0024233. Nonfederal funding was provided by NDIC and RTE. The authors would also like to thank CMG, ESRI, IHS, Neuralog, and Schlumberger for allowing the use of their software packages in support of this work.

42 ENGINEERING↗
DOE OSTI2022

EERC Final Topical Report – Findings on Subtask 3.2 – Produced Water Management Through Geologic Homogenization, Conditions, and Reuse

The Energy & Environmental Research Center (EERC) was awarded a contract by the North Dakota Industrial Commission (NDIC) Oil and Gas Research Program (NDIC No. G-051-101) to conduct a study on the recycling of water used in oil and gas operations, also known as produced water, from oil- and gas-producing regions of North Dakota as directed by Section 19 of North Dakota House Bill 1014. This final report provides a compilation of results of the study, which include regulatory, scientific, technological, and feasibility methods and considerations associated with North Dakota produced water management. The report provides a synopsis of this project’s previously submitted produced water assessment report entitled “Produced Water Management and Recycling Options in North Dakota” (Energy & Environmental Research Center, 2020), with updated values provided as appropriate. The report provides the results from the investigation of a novel produced water management strategy, referred to as geologic homogenization, conditioning, and reuse (GHCR), which aims to use a subsurface geologic formation as a natural medium for managing produced water recycling and reuse. Water management is a significant technical and economic challenge for sustainable oil and gas production, and water volumes are intrinsically linked to oil production volumes. North Dakota oil production rose to over 1.5 million barrels (MMbbl)/day in 2019, and despite a downturn in oil price in early 2020, North Dakota oil production has recovered to 1.1 MMbbl/day as of August 2021. Bakken petroleum system development between 2008 and 2020 has resulted in a nearly fourfold increase in produced water volumes to 642 MMbbl/yr in 2020 after peaking at 740 MMbbl/yr in 2019 and a fivefold increase in saltwater disposal (SWD) volumes to 565 MMbbl/yr in 2020 after a peak of 682 MMbbl/yr in 2019. Produced water and SWD volumes are forecasted to double by 2030. SWD is the primary method of produced water management used in North Dakota, with approximately 95% of the SWD volume occurring through subsurface injection into sandstones of the Dakota Group (Dakota). Localized pressurization of the Dakota resulting from SWD and projected increases in produced water volumes could impact the economics of North Dakota oil production. As a result, there is an emerging need to pursue alternative produced water management approaches, including recycling and reuse. While produced water recycling is not yet widespread, commercial operators are making strides in overcoming the technical challenges of using high salinity produced water in completion operations (Marathon Oil, 2020). As water management continues to be a key focal point in companies’ environmental, social, and governance (ESG) initiatives, focus on water management, including recycling, will likely continue to increase. Laboratory column testing, field sample collection, geologic modeling and numerical simulation, and techno-economic analysis all indicate that GHCR could feasibly be implemented as a potential water management option. Laboratory column testing and field sample collection indicate that the Inyan Kara sandstone and native formation fluid are capable of homogenizing with the Bakken produced water to a point where the fluid composition appears to stabilize. Extracting that stabilized fluid could be considered homogeneous and capable of providing individual batches of hydraulic fracturing fluid. Numerical simulation results indicate that extraction of fluids from the Inyan Kara in a GHCR implementation scenario is capable of reducing formation pressure, which would help ease localized pressurization of the Inyan Kara and extend the available capacity for nearby existing SWD wells. Economic analysis indicates that there are scenarios where GHCR implementation can be a competitive or even lower-cost option than a conventional water management approach. Site-specific conditions will dictate the economic potential of GHCR, but potentially attractive sites for GHCR implementation will be those that are located above a pressurized zone of the Inyan Kara, need six or more Bakken infill wells, and face high costs for conventional SWD and/or freshwater. Based on the regulatory review, drilling into the Inyan Kara for SWD and to harness as a source water for industrial use have precedent in North Dakota, and a workable regulatory solution for GHCR seems likely. However, restrictions in the state regarding surface storage and transport of produced fluids may limit some activities, which will affect how GHCR could ultimately be implemented. In summary, this study reveals pursuing GHCR can be a viable approach to water management in North Dakota. The GHCR concept addresses some of the challenges that hinder the more traditional approaches to recycling in the industry. Furthermore, an assessment of the current landscape of water management within the state reveals the ongoing trend of increasing volumes of produced water and SWD. Projections reveal that the volumes of produced water that need to be managed are expected to double over the next decade (Energy & Environmental Research Center, 2020). With the continued development of the Bakken and continuing driving factors related to ESG initiatives, implementing a practice such as GHCR is a feasible approach to adding recycling of produced water to industry within the state. This subtask was cofunded through the EERC–U.S. Department of Energy Joint Program on Research and Development for Fossil Energy-Related Resources Cooperative Agreement No. DE-FE0024233. Nonfederal funding was provided by the North Dakota Industrial Commission Oil and Gas Research Program. References Energy & Environmental Research Center, 2020, Produced water management and recycling options in North Dakota: Final Report for North Dakota Legislative Management Energy Development and Transmission Committee and North Dakota Industrial Commission. Marathon Oil, 2020, Sustainability report: https://cdn.sanity.io/files/ghcnw9z2/website/ 91744eb6ef8fbe59505a911c6b8d2e8dd9a537fa.pdf?dl (accessed November 2021).

02 PETROLEUM↗
DOE OSTI2022

Modelica-json: Transforming energy models to digitize the control delivery process

Building simulation models are typically not used to generate the documentation required for bidding and project delivery of commercial building systems, or for their semantic modeling and commissioning. This paper presents a software tool that aids in digitizing the control delivery process, spanning simulation during design to implementation and formal verification during commissioning. The tool can generate from Modelica models digital documentation of control sequences. This digital documentation, along with other project drawings and specifications can be used for project bidding. It can also be used for implementation of control sequences through machineto-machine translation to commercial legacy control products, for which we are currently developing the proposed ASHRAE Standard 231P based on the presented work. Moreover, as-installed control sequences can be formally verified against the design specification, and a semantic model in Brick can be exported to aid in configuration of building analytics and fault detection. The paper presents what we believe is the first translation of a Modelica-implemented control sequence to a native implementation on a commercial control platform, using the webCTRL product line from Automated Logic. The paper also shows how a webCTRL implementation can be formally verified against its Modelica specification. These use cases have all been demonstrated with a prototype implementation that is now being further developed.

Wetter, Michael↗
DOE OSTI2023

Modbus RTU for Embedded Cyber Secure Inverter Controller

The Modbus communication protocol is a widely adopted communication standard in industrial control systems. This communication protocol is known for being reliable and straightforward to implement while being versatile in terms of its operating parameters while supporting multiple formats over various hardware infrastructures and architectures. Many intelligent devices such as Programmable Logic Controllers (PLCs), Human-Machine Interfaces (HMIs), Internet-of-Things (IoT), and various Operational Technologies (OT) utilize Modbus for their communication systems. These types of systems must communicate with each other through a standardized and central communication process. To support the integration of these modular systems, a Field-Programmable Gate Array (FPGA) can act as an embedded central routing fabric for this communication to take place. Embedded systems are versatile enough to interface with various devices and systems to accomplish various goals. Additionally, embedded systems require relatively small physical designs to minimize the required resources to facilitate the intended application by providing low-level system access. This minimization of system resources goes hand in hand with reducing the financial cost of a proposed solution or system. As remotely collaborating researchers often use FPGAs to prototype designs that are required to have a method for data transmission among systems, it is imperative to provide a baseline standard for communications among devices and systems. A typical method of implementing the Modbus RTU communication protocol in an embedded environment is using integrated logic architectures within the FPGA called “Intellectual Property (IP) cores.” IP cores can be designed using integrated logic or circuit designs to function as an embedded processor. These IP cores can then perform the required computational actions to support the Modbus RTU communication protocol by utilizing high-level programming languages such as the C programming language. The hardware description language of Very High-Speed Integrated Circuit Hardware Description Language (VHDL) allows for the control of real hardware at the logic gate and signal level. These logic gates and signals can be designed and controlled to perform desired actions based on the system design. Programming an FPGA using VHDL allows an individual to access the lowest abstraction level of the system during FPGA development. This level of abstraction is referred to as the register-transfer level (RTL), which gives access to manipulating values and variables at the register level. This register-level manipulation provides precision over creating the logical circuit within the FPGA, thus minimizing the required code to perform desired operations. The Modbus RTU communication protocol can be implemented within an FPGA using VHDL programming to establish a standardized and embedded serial communication pathway. This implementation provides a standardized communication protocol to streamline research efforts among researchers, thus increasing the efficiency of research efforts. Additionally, this Modbus RTU implementation requires fewer resources when compared to typical communication protocol implementations that utilize an IP core, reducing the hardware requirement for effective research efforts.

communication↗
DOE OSTI2021

Porting the Nonlinear Optimization Library HiOp to Accelerator-Based Hardware Architectures

While interior point method has been the centerpiece of nonlinear programming tools used in science and engineering, its reliance on linear solvers that can tackle sparse symmetric indefinite and highly ill-conditioned problems made it difficult to implement it effectively on hardware accelerators. HiOp optimization package attempts to provide an implementation of the interior point method suitable for hardware accelerators by compressing the original sparse problem to produce an underlying linear problem that is dense and of manageable size. Implementations of dense linear solvers are more mature and utilize hardware accelerators better than their sparse counterparts. There is a number of important domain problems, such as optimal power flow analysis for power grids, where the sparse problem can be effectively compressed and deploying dense linear solver within the interior point method can improve performance. Here we describe a portable implementation of HiOp optimization engine, which uses a linear solver from Magma library and runs entirely on hardware accelerators. To compress the problem, HiOp uses customized mixed dense-sparse linear algebra. All HiOp kernels are implemented using Umpire and RAJA portability libraries. We describe details of the implementation and discuss trade-offs between performance, portability and development cost.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A time‐varying formulation of the curled wake model within the FAST.Farm framework

Abstract In this article, we present a time‐varying formulation of the curled wake model that we implemented in FAST.Farm. The curled wake model, originally developed for steady‐state conditions, is used to produce realistic wake profiles behind a wind turbine in yawed (or skewed) conditions. We begin by introducing the key elements of the FAST.Farm framework. Then, after briefly summarizing the original wake dynamics formulation of FAST.Farm based on a polar wake profile, we present the new time‐varying formulation of the curled wake model, compare the two, and highlight the differences with the original curled wake model. After discussing some implementation details, we present different applications with increasing levels of complexity: single turbine with uniform and turbulent inflow, fixed and transient yaw, and multiple turbines. We verify our results using the original FAST.Farm implementation and large‐eddy simulations. The results with the new curled wake model are improved compared to the original implementation, as they include cross‐flow velocities and wake asymmetry. Yet, large‐eddy simulation results show a more pronounced lateral convection of the wake and a stronger concentration of vorticity at the top vortex. The new curled wake implementation in FAST.Farm should enable the calculation of not only generator power but also wind turbine structural loads for applications involving intentional or unintentional skewed flow and wind‐farm control involving wake steering.

17 WIND ENERGY↗
DOE OSTI2023

Experimental Characterization of OpenMP Offloading Memory Operations and Unified Shared Memory Support

The OpenMP specification recently introduced support for unified shared memory, allowing implementation to leverage underlying system software to provide a simpler GPU offloading model where explicit mapping of variables is optional. Support for this feature is becoming more available in different OpenMP implementations on several hardware platforms. A deeper understanding of the different implementation’s execution profile and performance is crucial for applications as they consider the performance portability implications of adopting a unified memory offloading programming style. This work introduces a benchmark tool to characterize unified memory support in several OepnMP compilers and runtimes, with emphasis on identifying discrepancies between different OpenMP implementations as to how they various memory allocation strategies interact with unified shared memory. The benchmark tool is used to characterize OpenMP compilers on three leading High Performance Computing platforms supporting different CPU and device architectures. The benchmark tool is used to assess the impact of enabling unified shared memory on the performance of memory-bound code, highlighting implementation differences that should be accounted for when applications consider performance portability across platforms and compilers.

Elwasif, Wael↗
DOE OSTI2023

Online transfer learning strategy for enhancing the scalability and deployment of deep reinforcement learning control in smart buildings

In recent years, advanced control strategies based on Deep Reinforcement Learning (DRL) proved to be effective in optimizing the management of integrated energy systems in buildings, reducing energy costs and improving indoor comfort conditions when compared to traditional reactive controllers. However, the scalability and implementation of DRL controllers are still limited since they require a considerable amount of time before converging to a near-optimal solution. This issue is currently addressed in literature through the offline pre-training of the DRL agent. However this solution results in two main critical issues: (1) the need to develop a building surrogate model to perform the training task, and (2) the need to perform a fine-tuning process over several training episodes to obtain a near-optimal control policy. In this context, this paper introduces an Online Transfer Learning (OTL) strategy that exploits two knowledge-sharing techniques, weight-initialization and imitation learning, to transfer a DRL control policy from a source office building to various target buildings in a simulation environment coupling EnergyPlus and Python. A DRL controller based on discrete Soft Actor–Critic (SAC) is trained on the source building to manage the operation of a cooling system consisting of a chiller and a thermal storage. Several target buildings are defined to benchmark the performance of the OTL strategy with that of a Rule-Based Controller (RBC) and two DRL-based control strategies, deployed in offline and online fashion. The strategy adopted for OTL emulates the real world implementation with a simulation process by implementing the transferred DRL agent for a single episode in the target buildings. Target buildings have the same geometrical features and are served by the same energy system as the source building, but differ in terms of weather conditions, electricity price schedules, occupancy patterns, and building envelope efficiency levels. The results show that the OTL strategy can reduce the cumulated sum of temperature violations on average by 50% and 80% respectively when compared to RBC and online DRL while enhancing the energy system operation with electricity cost savings ranging between 20% and 40%. Furthermore, the OTL agent performs slightly worse than the offline DRL controller but it does not require any modeling effort and can be implemented directly on target buildings emulating a real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Genarris 2.0: A Random Structure Generator for Molecular Crystals

Genarris is an open source Python package for generating random molecular crystal structures with physical constraints for seeding crystal structure prediction algorithms and training machine learning models. Here we present a new version of the code, containing several major improvements. A MPI-based parallelization scheme has been implemented, which facilitates the seamless sequential execution of user-defined workflows. A new method for estimating the unit cell volume based on the single molecule structure has been developed using a machine-learned model trained on experimental structures. A new algorithm has been implemented for generating crystal structures with molecules occupying special Wyckoff positions. A new hierarchical structure check procedure has been developed to detect unphysical close contacts efficiently and accurately. New intermolecular distance settings have been implemented for strong hydrogen bonds. To demonstrate these new features, we study two specific cases: benzene and glycine. Genarris finds the experimental structures of the two polymorphs of benzene and the three polymorphs of glycine. Program summary Program Title: Genarris 2.0 Program Files doi: http://dx.doi.org/10.17632/grx6mz4pjn.1 Licensing provisions: BSD-3 Clause Programming language: Python, C External routines/libraries: Spglib, ASE, pymatgen, SciPy, mpi4py, scikit-learn, PyTorch, FHI-aims. Nature of problem: Molecular crystal structure prediction. Solution method: Genarris 2.0 generates molecular crystal structures over the 230 space groups, on general and special Wyckoff positions, using physical constraints. Down-sampling of the generated structures may be performed subsequently, based on molecular crystal packing descriptors and an unsupervised machine learning algorithm. Lastly, ab initio structure relaxation may be performed for the final pool. Depending on the user-defined workflow implemented, Genarris may be used to generate diverse molecular crystal datasets to seed evolutionary algorithms or to train machine learning algorithms or as a standalone crystal structure prediction method. Restrictions: For crystal structure generation, the molecule of interest must be semi-rigid with no bond rotational degrees of freedom. Unusual features: Genarris 2.0 is a highly distributed program, making use of MPI for Python parallelization. The user has the ability to design and implement workflows by executing a user-defined list of procedures. Genarris 2.0 offers new features including a machine learning model for estimating the molecular volume in the solid state from the single molecule structure, structure generation in special Wyckoff positions of space groups, hierarchical structure checks including rigorous treatment of non-orthogonal structures, and clustering and down-selection workflows combining first principles simulations with machine learning. (C) 2020 Elsevier B.V. All rights reserved.

Crystal structure prediction↗
DOE OSTI2025

Simplifying activations with linear approximations in neural networks

A key step in Neural Networks is activation. Among the different types of activation functions, sigmoid, tanh, and others involve the usage of exponents for calculation. From a hardware perspective, exponential implementation implies the usage of Taylor series or repeated methods involving many addition, multiplication, and division steps, and as a result are power-hungry and consume many clock cycles. We implement a piecewise linear approximation of the sigmoid function as a replacement for standard sigmoid activation libraries. This approach provides a practical alternative by leveraging piecewise segmentation, which simplifies hardware implementation and improves computational efficiency. In this paper, we detail piecewise functions that can be implemented using linear approximations and their implications for overall model accuracy and performance gain. Our results show that for the DenseNet, ResNet, and GoogLeNet architectures, the piecewise linear approximation of the sigmoid function provides faster execution times compared to the standard TensorFlow sigmoid implementation while maintaining comparable accuracy. Specifically, for MNIST with DenseNet, accuracy reaches 99.91% (Piecewise) vs. 99.97% (Base) with up to 1.31x speedup in execution time. For CIFAR-10 with DenseNet, accuracy improves to 98.97% (Piecewise) vs. 99.40% (Base) while achieving 1.24x faster execution. Similarly, for CIFAR-100 with DenseNet, the accuracy is 97.93% (Piecewise) vs. 98.39% (Base), with a 1.18x execution time reduction. These results confirm the proposed method’s capability to efficiently process large-scale datasets and computationally demanding tasks, offering a practical means to accelerate deep learning models, including LSTMs, without compromising accuracy.

Activation function↗
DOE OSTI2024

Acceleration of Graph Neural Network-Based Prediction Models in Chemistry via Co-Design Optimization on Intelligence Processing Units

Atomic structure prediction and associated property calculations are the bedrock of chemical physics. Since high-fidelity ab initio modeling techniques for computing the structure and properties can be prohibitively expensive, this motivates the development of machine-learning (ML) models that make these predictions more efficiently. Training graph neural networks over large atomistic databases introduces unique computational challenges such as the need to process millions of small graphs with variable size and support communication patterns that are distinct from learning over large graphs such as social networks. We demonstrate a novel hardware-software co-design approach to scale up the training of atomistic graph neural networks (GNN) for structure and property prediction. First, to eliminate redundant computation and memory associated with alternative padding techniques and to improve throughput via minimizing communication, we formulate the effective coalescing of the batches of variable-size atomistic graphs as the bin packing problem and introduce a hardware-agnostic algorithm to pack these batches. In addition, we propose hardware-specific optimizations including a planner and vectorization for the gather-scatter operations targeted for Graphcore’s Intelligence Processing Unit (IPU), as well as model-specific optimizations such as merged communication collectives and optimized softplus. Putting these all together, we demonstrate the effectiveness of the proposed co-design approach by providing an implementation of a well-established atomistic GNN on the Graphcore IPUs. We evaluate the training performance on multiple atomistic graph databases with varying degrees of graph counts, sizes and sparsity. Here, we demonstrate that such a co-design approach can reduce the training time of atomistic GNNs and can improve the performance by up to 1.5× compared to the baseline implementation of the model on the IPUs. Additionally, we compare our IPU implementation with a Nvidia GPU-based implementation and show that our atomistic GNN implementation on the IPUs can run 1.8× faster on average compared to the execution time on the GPUs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Integrated-photonics-based systems for polarization-gradient cooling of trapped ions

Trapped ions are a promising modality for quantum systems, with demonstrated utility as the basis for quantum processors and optical clocks. However, traditional trapped-ion systems are implemented using complex free-space optical configurations, whose large size and susceptibility to vibrations and drift inhibit scaling to large numbers of qubits. In recent years, integrated-photonics-based systems have been demonstrated as an avenue to address the challenge of scaling trapped-ion systems while maintaining high fidelities. While these previous demonstrations have implemented both Doppler and resolved-sideband cooling of trapped ions, these cooling techniques are fundamentally limited in efficiency. In contrast, polarization-gradient cooling can enable faster and more power-efficient cooling and, therefore, improved computational efficiencies in trapped-ion systems. While free-space implementations of polarization-gradient cooling have demonstrated advantages over other cooling mechanisms, polarization-gradient cooling has never previously been implemented using integrated photonics. In this paper, we design and experimentally demonstrate key polarization-diverse integrated-photonics devices and utilize them to implement a variety of integrated-photonics-based polarization-gradient-cooling systems, culminating in the first experimental demonstration of polarization-gradient cooling of a trapped ion by an integrated-photonics-based system. By demonstrating polarization-gradient cooling using an integrated-photonics-based system and, in general, opening up the field of polarization-diverse integrated-photonics-based devices and systems for trapped ions, this work facilitates new capabilities for integrated-photonics-based trapped-ion platforms.

atom optics↗
DOE OSTI2020

TurboRVB: A many-body toolkit for ab initio electronic simulations by quantum Monte Carlo

TurboRVB is a computational package for ab initio Quantum Monte Carlo (QMC) simulations of both molecular and bulk electronic systems. The code implements two types of well established QMC algorithms: Variational Monte Carlo (VMC) and diffusion Monte Carlo in its robust and efficient lattice regularized variant. A key feature of the code is the possibility of using strongly correlated many-body wave functions (WFs), capable of describing several materials with very high accuracy, even when standard mean-field approaches [e.g., density functional theory (DFT)] fail. The electronic WF is obtained by applying a Jastrow factor, which takes into account dynamical correlations, to the most general mean-field ground state, written either as an antisymmetrized geminal power with spin-singlet pairing or as a Pfaffian, including both singlet and triplet correlations. This WF can be viewed as an efficient implementation of the so-called resonating valence bond (RVB) Ansatz, first proposed by Pauling and Anderson in quantum chemistry [L. Pauling, The Nature of the Chemical Bond (Cornell University Press, 1960)] and condensed matter physics [P.W. Anderson, Mat. Res. Bull 8, 153 (1973)], respectively. The RVB Ansatz implemented in TurboRVB has a large variational freedom, including the Jastrow correlated Slater determinant as its simplest, but nontrivial case. Moreover, it has the remarkable advantage of remaining with an affordable computational cost, proportional to the one spent for the evaluation of a single Slater determinant. Therefore, its application to large systems is computationally feasible. The WF is expanded in a localized basis set. Several basis set functions are implemented, such as Gaussian, Slater, and mixed types, with no restriction on the choice of their contraction. The code implements the adjoint algorithmic differentiation that enables a very efficient evaluation of energy derivatives, comprising the ionic forces. Thus, one can perform structural optimizations and molecular dynamics in the canonical NVT ensemble at the VMC level. For the electronic part, a full WF optimization (Jastrow and antisymmetric parts together) is made possible, thanks to state-of-the-art stochastic algorithms for energy minimization. In the optimization procedure, the first guess can be obtained at the mean-field level by a built-in DFT driver. The code was efficiently parallelized by using a hybrid MPI-OpenMP protocol, which is also an ideal environment for exploiting the computational power of modern Graphics Processing Unit accelerators.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗