Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

We present hls4ml, a free and open-source platform that translates machine learning (ML) models from modern deep learning frameworks into high-level synthesis (HLS) code that can be integrated into full designs for field-programmable gate arrays (FPGAs) or application-specific integrated circuits (ASICs). With its flexible and modular design, hls4ml supports a large number of deep learning frameworks and can target HLS compilers from several vendors, including Vitis HLS, Intel oneAPI and Catapult HLS. Together with a wider eco-system for software-hardware co-design, hls4ml has enabled the acceleration of ML inference in a wide range of commercial and scientific applications where low latency, resource usage, and power consumption are critical. In this paper, we describe the structure and functionality of the hls4ml platform. The overarching design considerations for the generated HLS code are discussed, together with selected performance results.

Schulte, Jan-Frederik [Purdue U.] (ORCID:000000034↗

Framework for Assessing Impact of Wave-Powered Desalination on Resilience of Coastal Communities

Coastal communities face unique challenges in maintaining continuous service from critical infrastructure. This research advances capabilities for evaluating the impact of using wave energy to desalinate water on the resilience of coastal communities. The study focuses on the feasibility of using wave energy conversion to provide drinking water to communities in need and applying resilience metrics to quantify its impact on the community. To assess the feasibility of wave-powered desalination, this research couples the open-source software Wave Energy Converter SIMulator (WEC-Sim) and Water Network Tool for Resilience (WNTR). This research explores variations in both the wave resource (location, seasonality, and duration) and the ability to maintain drinking water service during a disruption scenario by applying the simulation framework to three case studies, which are based on communities in Puerto Rico. The simulation framework provides a contextualized assessment of the ability of wave-powered desalination to improve the resilience of coastal communities, which can serve as a methodology for future studies seeking the integration of wave-powered desalination with water distribution systems.

16 TIDAL AND WAVE POWER↗

Tracking materials science data lineage to manage millions of materials experiments and analyses

Abstract In an era of rapid advancement of algorithms that extract knowledge from data, data and metadata management are increasingly critical to research success. In materials science, there are few examples of experimental databases that contain many different types of information, and compared with other disciplines, the database sizes are relatively small. Underlying these issues are the challenges in managing and linking data across disparate synthesis and characterization experiments, which we address with the development of a lightweight data management framework that is generally applicable for experimental science and beyond. Five years of managing experiments with this system has yielded the Materials Experiment and Analysis Database (MEAD) that contains raw data and metadata from millions of materials synthesis and characterization experiments, as well as the analysis and distillation of that data into property and performance metrics via software in an accompanying open source repository. The unprecedented quantity and diversity of experimental data are searchable by experiment and analysis attributes generated by both researchers and data processing software. The search web interface allows users to visualize their search results and download zipped packages of data with full annotations of their lineage. The enormity of the data provides substantial challenges and opportunities for incorporating data science in the physical sciences, and MEAD’s data and algorithm management framework will foster increased incorporation of automation and autonomous discovery in materials and chemistry research.

Soedarmadji, Edwin↗

S4PST: Sustainability for Programming Systems and Tools: May Workshop Report

The US Department of Energy (DOE) Exascale Computing Project (ECP) has fostered and strengthened the use of modern software engineering practices for developing applications and libraries, and this effort has resulted in the coordinated and interoperable E4S1 and xSDK2 ecosystems. Although this approach is cost-effective, it relies on robust programming systems and tools (PST) as the underlying foundation for our HPC software. At present, our primary PST stack consists of traditional high-performance computing (HPC) languages, namely Fortran, C, C++, and the popular Python language for data analysis and AI workflows. These languages support various programming frameworks and run-time abstractions that enable parallelism and concurrency across multiple node architectures and thousands of nodes through a variety of interconnect systems. However, to accommodate users’ diverse needs, certain aspects of the HPC ecosystem are delegated to vendor-specific or third-party implementations that extend beyond a particular scientific domain. This broader scope results in a multitude of specifications and variations, which leads to a complex orchestration of many-ecosystems. Unfortunately, this complexity in the ecosystem imposes additional overhead costs on consumers during the latter stages of the development cycle. In addition to the software ecosystem challenge, the upcoming conclusion of the ECP by December 2023 has raised significant concerns within the HPC programming systems community, from both the economic and social perspectives. The ECP has implemented a management structure for software development and funding decisions across all ECP participants by following a conventional hierarchical and centralized approach. However, this structure has prompted certain considerations within the community, particularly in anticipation of the Software Sustainability initiative by the DOE’s Advanced Scientific Computing Research Program (ASCR). For the success of this new initiative, it is of utmost importance to secure consistent funding and foster close engagement with researchers and core developers of existing programming-system products. This collaboration is vital to maintaining the critical capabilities of the current software during the transition phase while proactively adapting to future technology and workforce trends. The community recognizes the significance of adapting to emerging trends and is aware of the inherent fragility of the HPC software ecosystem, particularly in relation to programming systems that cater to all users. The ability to adapt and evolve is essential to staying relevant and effectively addressing these technical, economic, and social challenges. The S4PST team, which represents one of the six ASCR Software Sustainability seedling projects, is dedicated to tackling these challenges through community-based approaches that go beyond the scope of the DOE. This involves collaboration between national laboratories with academia, non-DOE institutions, hardware and system vendors, and international partners. By fostering these partnerships, we aim to create a robust and sustainable HPC software ecosystem that can effectively meet the needs of the community. This new community effort, driven by the eight DOE labs, will take on the responsibility of guiding funding decisions for programming-systems development and maintenance with transparency and consistency across all decisions. Additionally, the team will offer common technical services to the programming systems community, irrespective of their funding situations, and facilitate community-wide incubation to proactively nurture the software ecosystem. By actively engaging with stakeholders and employing a collaborative approach, we can collectively shape the future of programming systems and ensure a robust and thriving HPC software landscape. On May 11–12, 2023, the S4PST team conducted its inaugural kick-off workshop at the Innovative Computing Laboratory (ICL) in the University of Tennessee, Knoxville, hosted by Hartwig Anzt. The workshop encompassed various sessions dedicated to presentations and discussions, with the aim of comprehending the team members’ perspectives on the vision of software sustainability. Additionally, the workshop aimed to identify the technical, economic, and social requirements for sustaining the programming-systems community in the field of HPC. This report provides a summary of the S4PST effort by highlighting five major thrust areas discussed during the workshop: (i) community, (ii) technical support, (iii) training and diversity, (iv) verification, validation and correctness, and (v) emerging technologies. It also encompasses an overview of the presentations and discussions held throughout the event, our views and potential synergies with other seedling efforts, along with the outcomes and key takeaways from our initial discussions.

97 MATHEMATICS AND COMPUTING↗

DLIO: A DATA-CENTRIC BENCHMARK FOR DEEP LEARNING APPLICATIONS

SF-22-136 Deep learning has been shown as a successful method for various tasks, and its popularity results in numerous open-source deep learning software tools. Deep learning has been applied to a broad spectrum of scientific domains such as cosmology, particle physics, computer vision, fusion, and astrophysics. Scientists have performed a great deal of work to optimize the computational performance of deep learning frameworks. However, the same cannot be said for I/O performance. As deep learning algorithms rely on big-data volume and variety to effectively train neural networks accurately, I/O is a significant bottleneck on large-scale distributed deep learning training. DLIO, is a novel representative benchmark suite built based on the I/O profiling of the selected workloads. DLIO can be utilized to accurately emulate the I/O behavior of modern deep learning applications. Using DLIO, application developers and system software solution architects can identify potential I/O bottlenecks in their applications and guide optimizations to boost the I/O performance leading to lower training times. The storage vendor can also use DLIO as a guide for designing and optimize the storage and filesystem targeting at deep learning application.

ZHENG, HUIHUO↗

Dual Context: Leveraging Structured Application Context for Code Generation and Runtime Feature Activation via Chat Interfaces

Integrating artificial intelligence (AI) capabilities into software applications typically involves two common paths. For developers, AI assists in generating and documenting source code and other related software engineering efforts. For users, AI assists them through question-and-answer exchanges via chatbots. Both approaches have their value, but neither effectively leverages the modularity of component-based architectures that modern web application frameworks offer. We implement a proof of concept within a centralized suite of applications used for the Atmospheric Radiation Measurement (ARM) Data Center Operational Tools, where we introduce a third integration path through the ARM Context Engine (ACE). ACE is a context driven system that uses structured contextual specifications to enable Large Language Models (LLMs) to render interactive and feature-rich user interface (UI) components directly within chat responses, alongside or in place of conventional text outputs. These specifications serve two important purposes across what we call code context and UI context. Code context provides AI-assisted development tools with structured application knowledge beyond raw code, including component relationships, architectural patterns and schematic information, enabling the generation of consistent, well-structured code. UI context defines the rules for enabling and rendering component features at runtime based on the user's natural language input, allowing end users to activate capabilities such as data export, filtering, and pagination within chat responses, without requiring code changes or redeployment. We demonstrate, through a comparative evaluation against general-purpose AI chatbots, that context-driven component rendering provides interactive capabilities that text-based responses cannot replicate, including deterministic component behavior, application-consistent design language, and on-demand feature activation. A development effort comparison further shows that features that traditionally require multi-step development cycles can be activated with a single naturallanguage request. In this ongoing work, we present ACE as an emerging approach to AI integration that positions modular, well-documented software architecture as the foundation for AI-ready applications. ACE treats context as a shared resource across both development and user-facing AI, bringing cohesion to conventionally disconnected efforts, bridging developer tooling and end-user capabilities within a single framework.

Tadimeti, Vijay [ORNL]↗

Progress on Plant-Level Components for Nuclear Fuel Recycling: Commonality

Progress made in developing a common mathematical modeling framework for plant-level components of a simulation toolkit for nuclear fuel recycling is summarized. This ongoing work is performed under the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, which has an element focusing on safeguards and separations (SafeSeps). One goal of this element is to develop a modeling and simulation toolkit for used nuclear fuel recycling. The primary function of the SafeSeps simulation toolkit is to enable the time-dependent coupling of separation modules and safeguards tools (either native or third-party supplied) that simulate and/or monitor the individual separation processes in a separations plant. The toolkit integration environment will offer an interface for the modules to register in the toolkit domain based on the commonality of diverse unit operations. This report discusses the source of this commonality from a combined mathematical modeling and software design perspectives, and it defines the initial basic concepts needed for development of application modules and their integrated form, that is, an application software. A unifying mathematical theory of chemical thermomechanical network transport for physicochemical systems is proposed and outlined as the basis for developing advanced modules. A program for developing this theory from the underlying first-principles continuum thermomechanics will be needed in future developments; accomplishment of this task will enable the development of a modern modeling approach for plant-level models. Rigorous, advanced modeling approaches at the plant-level can only proceed from the development of reduced (or low-order) models based on a solid continuum field theory foundation. Such development will pave the way for future programmatic activities on software verification, simulation validation, and model uncertainty quantification on a scientific basis; currently, no satisfactory foundation exists for considering these activities. The exploitation of mathematical commonality for unit operations with the intent of developing generic and comprehensive software for nuclear reprocessing has not been considered to this author's knowledge. Past attention has been given to plant-level processes on an individual and isolated basis, which has led to various models and corresponding codes implementing non-systematic approaches based on elementary principles of chemical processing. This practice has built an initial knowledge base, but it was not fruitful in producing a lasting and extensible simulation capability. In contrast, a common, rigorous, mathematical modeling framework for all plant-level operations, as proposed here, has a tremendous practical and theoretical value because it will reduce the software implementation work, creates a well-defined modeling standard to compare past and future models, and, more importantly, opens the doors for scientific considerations of simulation fidelity; the latter has an obvious beneficial impact in supporting experimental validation programs. Therefore, the proposed framework is likely to generate a solid foundation for modeling plant-level processes for physicochemical nuclear (and non-nuclear) applications. Demonstration of concrete module implementation is the subject of future communications including prototypes for several modules, namely, voloxidation, dissolver, digester, accountability tank, and solvent extraction. Unit-operation commonality is a key aspect to be explored for a successful implementation of these modules aimed at realizing various flowsheets and plant configurations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Automated Generation of Integrated Digital and Spiking Neuromorphic Machine Learning Accelerators

The growing numbers of application areas for artificial intelligence (AI) methods have led to an explosion of domain-specific accelerators that could support every new machine learning (ML) algorithm advancement, clearly highlighting the need for a capability to quickly and automatically transition from algorithm definition to hardware implementation and explore design space along a variety of SWaP (size, weight and Power). The software defined architectures (SODA) synthesizer implements a compiler-based modular infrastructure for the end-to-end generation of machine learning accelerators from high-level frameworks to hardware description language. At the same time, neuromorphic computing, by mimicking how the brain operates, promises to perform artificial intelligence tasks at efficiencies orders of magnitude higher than the current conventional tensor-processing based accelerators, as demonstrated by a variety of specialized designs leveraging Spiking Neural Networks (SNNs). Nevertheless, the mapping of an artificial neural network (ANN) to solutions supporting SNNs is still a non-trivial and very device-specific task, and completely lack the possibility to design hybrid systems that integrate conventional and spiking neural models. In this paper we discuss the support for such an integrated generation leveraging the SODA Synthesizer framework and its modular structure. In particular, we present a new MLIR dialect (part of the SODA frontend) that allows expressing spiking neural network features (e.g., available resources, spiking sequences, analog signal reading, etc.) and illustrate how it enables mapping to Spiking Neurons and deployment to the related specialized hardware (which, in the digital domain, could be generated through the other existing layers of the SODA Synthesizer). We then discuss the opportunities for even deeper integration afforded by the hardware compilation infrastructure, providing a path towards the generation of complex heterogeneous artificial intelligence systems.

Curzel, Serena↗

Deffe: A Data-efficient Framework for Performance Characterization in Domain-Specific Computing

Predicting workload performance is a crucial task for many architecture and system research. In this paper we present De￿e, a framework to estimate the workload performances under varying architectural configurations. The infrastructure component of Deffe is based on scalable and easy-to-use open-source software components. By casting the performance modeling as transfer learning tasks, the modeling component of Deffe can leverage the learned knowledge on one workload, and “transfer” it to a new workload. Extensive experimental results show that the method can achieve superior testing accuracy with an effective reduction of 32-80x in terms of the amount of required training data.

Liu, Frank↗

Radiological Anomaly Detection And Identification (RADAI) v1.0

The Radiological Anomaly Detection and Identification (RADAI) software package is a python library for implementing, training, and storing algorithms that detect and identify anomalies in gamma-ray spectra. The library defines a general framework for implementing detection (binary) and identification (classification) algorithms, objects to encapsulate the results of analyses, a variety of temporal filtering tools that can be used in constructing algorithms, and conceptual design that allows easy reading and writing of algorithms (and their time dependent state). In addition to this framework, the library includes implementations of a variety of algorithms from the scientific literature including: gross-counts k-sigma, SPRT, N-SCRAD, Region of Interest, and Censored Energy Window. The implementation of these algorithms within the RADAI package was done to facilitate user-initiated training and configuration to by applied to different gamma-ray detector types. Finally, benchmarked and synthetic datasets will be made available for standardized algorithm characterization with corresponding utilities in the RADAI package for data access and processing.

Joshi, Tenzing↗

SpacelyProject/spacely-docs

Spacely is an open-source framework for the post-silicon validation of analog, digital, and mixed-signal ASICs (Application-Specific Integrated Circuits) which maximizes the reuse of hardware and software, reducing the time taken to achieve meaningful test results. Spacely specifically addresses the needs of small, flexible ASIC design teams commonly found in academia or research institutions. Spacely was originally developed at Fermi National Accelerator Laboratory.

Quinn, Adam [Fermi National Accelerator Laboratory↗

Web Extensible Display Manager 2

The Web Extensible Display Manager (WEDM) was first deployed at Jefferson Lab (JLab) in 2016 with the goal of rendering Extensible Display Manager (EDM) control screens on the web for the benefit of accessibility, and with version 2 our aim is to provide a more general purpose display toolkit by freeing ourselves from the constraints of the EDM dependency. Over the last few years WEDM has been extensively used at JLab for 24/7 information kiosks, on-call monitoring, and by remote users and staff. The software has also been deployed to Oak Ridge National Laboratory, and has become more robust as many bug fixes and contributions have been added. However, adoption and utility of the software as a general purpose control system display manager is limited by EDM, which is no longer actively maintained. A new toolkit can be built on modern frameworks, fully embrace web conventions and standards, and support multiple control system data sources. This new version is a result of a technology review and selection, and introduces a web inspired display file format, a web based display builder, new widgets, and a data interface intended to support pluggable data.

Slominski, R. J.↗

Euratom Fast Collar (EFC) Calibration Report

Neutron collars are used by international inspectorates to determine the amount of 235U in fresh LWR fuel assemblies. Standard neutron collars can operate in two modes: “fast” and “thermal”. In fast mode (using cadmium liners), thermal neutron are excluded from the assembly and the measurement results are not very sensitive to the presence of neutron poison loaded pins. In thermal mode, the thermal neutrons are affected by the presence of poison rods leading to significant effect, requiring corrections. These corrections depend on the declaration of the operator, reducing the independence of the inspectors’ measurements. The thermal mode signal is much higher than the fast mode signal and can give statistically acceptable results in ~600 seconds compared with ~1 hr for the fast mode. This report describes the calibration of a new fast neutron collar designed to use fast mode to reduce the effect of poison pins on verification measurements and with increased efficiency to reduce the measurement times to those normally used on inspection. The work was done in cooperation with the safeguards division of the European Commission and so the new collar is named the Euratom Fast Collar (EFC). The motivation and design work is presented in reference 2. The Monte Carlo simulations presented in reference 2 cover a larger parameter range than can be experimentally measured with the mock up assembly and so we base the performance on the simulation results, benchmarked to the measurements. The work presented here follows that of the “bible” of LWR fuel assembly measurements and uses the same mock-up assembly, with the same enriched, depleted and gadolinium poisoned fuel rods as were used in that work. Reference 1 describes how the measured count rate of the detector is corrected for AmLi source strength, electronic stability, efficiency, poison rods effects and heavy metal effects as well as other perturbing factors. These will be discussed below. INCC is the normal software that is used to collect and analyze neutron collar data. The results of this work have been formulated to fit into this existing INCC data analysis framework.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Advanced High-Performance Computational Modeling of the Seismic Response of High-Hazard and/or Nuclear Facilities and Critical Infrastructure at the NNSS

New methods for predicting the amplitude and variability of ground shaking from earthquakes (and explosions) are needed for seismic hazard analysis for buildings, nuclear power plants, and critical infrastructure at the NNSS. We are comparing existing 1-D and new 3-D geophysical methods for estimating the shear-wave velocity structure in the upper 30 meters of the ground surface (Vs30), which plays a major role in ground motion amplification and seismic response of buildings. We evaluate the performance of these methodologies at the U1a Complex at the NNSS and develop simple 1-D and high-resolution 3-D Vs30 models. We then emplace these high-resolution models into a background seismic velocity model. We will collaborate with Lawrence Livermore National Laboratory (LLNL) to conduct numerical modeling of the ground shaking at the NNSS using their high-performance computing technology and state-of-the-art ground motion simulation methodology. The primary work that was completed in FY 2019 was to acquire the seismic systems and familiarize staff at the NNSS with their use. We also worked on developing a collection plan with the Device Assembly Facility (DAF) at the NNSS, but due to time constraints and other ongoing projects at the DAF, we had to use U1a as a backup. We were able to coordinate the seismic survey, and we will complete the collection of seismic data in FY 2020. Additionally, during FY 2019, we completed the geologic framework model (GFM) for the U1a Complex and modeled the Yucca fault. LLNL worked with us through FY 2019 to prepare the data files for their modeling software and tested the software for reliability. In FY 2020 we will develop the end-to-end capability so that any facility could easily be modeled and the expected shaking from a local earthquake understood. The work in FY 2020 will include building fault models from the GFM and finalizing the velocity model analysis. The final simulations will be run for multiple rupture models, and final assessments will demonstrate the seismic hazard at the U1a Complex.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

An Open-Source Framework for Rapid Validation of Scientific ASICs

Spacely is an open-source framework for the post-silicon validation of analog, digital, and mixed-signal ASICs (Application-Specific Integrated Circuits) which maximizes the reuse of hardware and software, reducing the time taken to achieve meaningful test results. Spacely specifically addresses the needs of small, flexible ASIC design teams commonly found in academia or research institutions which benefit most from sharing the overhead of test stand creation between many unique ASIC designs. Spacely is a set of software, firmware, and design practices. It targets two primary hardware platforms (NI-PXI and Caribou) as well as offering extensible support for bench instruments. Spacely provides a high-level Python interface to all test hardware for accessibility, while also giving more sophisticated teams the opportunity to integrate custom test firmware. The design principles of Spacely are presented in brief. Current documentation is available at https://github.com/SpacelyProject/spacely-docs.

Quinn, Adam [Fermilab]↗

Bioreactor Optimization through Multi-Phase Flow Models (CRADA Final Report)

Chemical manufacturing uses 29% of energy in the United States and produces 925 million metric tons of CO2 annually. Biomanufacturing offers the potential to leverage America’s rich agricultural resources to produce critical chemicals such as lubricants, pharmaceutical precursors, and components of energetic materials that today are sourced extensively from overseas. The bioreactors used in biomanufacturing applications, such as one developed by Capra Biosciences, involve multiphase flow of biofilm-coated solid support particles that are continuously circulated in a fluidized state within the reactor along with a constant supply of oxygen via an aeration mechanism. In this project, Capra Biosciences and LBNL developed a multiscale modeling framework to simulate the multiphase flows of solid particles in a liquid-gas bubble mixture that occurs in the bioreactor using the current MFIX-Exa software, an opensource multiphase flow solver developed and maintained at LBNL and NETL. By leveraging HPC capabilities, this high-fidelity multiscale model was used to inform design decisions for bioreactor architecture to make them operationally efficient.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Open-Source Framework for Rapid Validation of Scientific ASICs

Spacely is an open-source framework for the post-silicon validation of analog, digital, and mixed-signal ASICs (Application-Specific Integrated Circuits) which maximizes the reuse of hardware and software, reducing the time taken to achieve meaningful test results. Spacely specifically addresses the needs of small, flexible ASIC design teams commonly found in academia or research institutions which benefit most from sharing the overhead of test stand creation between many unique ASIC designs. Spacely is a set of software, firmware, and design practices. It targets two primary hardware platforms (NI-PXI and Caribou) as well as offering extensible support for bench instruments. Spacely provides a high-level Python interface to all test hardware for accessibility, while also giving more sophisticated teams the opportunity to integrate custom test firmware. The design principles of Spacely are presented, along with a demonstrative example of using Spacely to test a pixel detector readout ASIC.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics

Bioinformatics researchers are increasingly confronted with analysis of ultra large-scale data sets, a problem that will only increase at an alarming rate in coming years. Recent developments in open source software, that is, the Hadoop project and associated software, provide a foundation for scaling to petabyte scale data warehouses on Linux clusters, providing fault-tolerant parallelized analysis on such data using a programming style named MapReduce. An overview is given of the current usage within the bioinformatics community of Hadoop, a top-level Apache Software Foundation project, and of associated open source software projects. The concepts behind Hadoop and the associated HBase project are defined, and current bioinformatics software that employ Hadoop is described. The focus is on next-generation sequencing, as the leading application area to date.

43 PARTICLE ACCELERATORS↗