Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software development tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Big Data in HEP: A comprehensive use case study

Experimental Particle Physics has been at the forefront of analyzing the worlds largest datasets for decades. The HEP community was the first to develop suitable software and computing tools for this task. In recent times, new toolkits and systems collectively called Big Data technologies have emerged to support the analysis of Petabyte and Exabyte datasets in industry. While the principles of data analysis in HEP have not changed (filtering and transforming experiment-specific data formats), these new technologies use different approaches and promise a fresh look at analysis of very large datasets and could potentially reduce the time-to-physics with increased interactivity. In this talk, we present an active LHC Run 2 analysis, searching for dark matter with the CMS detector, as a testbed for Big Data technologies. We directly compare the traditional NTuple-based analysis with an equivalent analysis using Apache Spark on the Hadoop ecosystem and beyond. In both cases, we start the analysis with the official experiment data formats and produce publication physics plots. Lastly, we will discuss advantages and disadvantages of each approach and give an outlook on further studies needed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Performance-Aligned LLMs for Generating Fast HPC Code

Optimizing scientific software is a difficult task because codebases are often large and complex, and performance can depend upon several factors including the algorithm, its implementation, and hardware among others. Causes of poor performance can originate from disparate sources and be difficult to diagnose. Recent years have seen a multitude of work that use large language models (LLMs) to assist in software development tasks. However, these tools are trained to model the distribution of code as text, and are not specifically designed to understand performance aspects of code. In this work, we introduce a reinforcement learning based methodology to align the outputs of code LLMs with performance. This allows us to build upon the current code modeling capabilities of LLMs and extend them to generate better performing code. Here, we demonstrate that our fine-tuned model improves the expected speedup of generated code over base models for a set of benchmark tasks from 0.9 to 1.6 for serial code and 1.9 to 4.5 for OpenMP parallel code.

Computer science↗

Deploying and Tracking Software with NCCS Software Provisioning

The National Center for Computational Sciences (NCCS) at Oak Ridge National Laboratory has a long history of deploying ground-breaking leadership-class supercomputers for the U.S. Department of Energy. The latest in this line of supercomputers is Frontier, the first supercomputer to break the exascale barrier (1018 floating-point operations per second) on the TOP500 list. Frontier serves a wide array of scientific domains, from traditional simulation-based workloads to newer AI and Machine Learning workloads. To best serve the NCCS user community, NCCS uses Spack to deploy a comprehensive software stack of scientific software packages, providing straightforward access to these packages through Lmod Environment Modules. Maintaining a large software stack while also including multiple new compiler releases each year is a very time-consuming task. Additionally, it is not straightforward to provide a software stack alongside existing vendor-provided software such as the HPE/Cray Programming Environment (CPE), and existing CPE, Spack, and Lmod integration does not allow for multiple versions of GPU libraries such as AMD’s ROCm to be used. To address these challenges and shortcomings, NCCS has developed the NCCS Software Provisioning tool (NSP)1, a tool for deploying and monitoring software stacks on HPC systems. NSP allows NCCS to quickly and effectively provision software stacks from the ground up using template-driven recipes and configuration files. NSP is successfully deployed on Frontier and several other NCCS clusters, enabling the NCCS software team to quickly deploy software stacks for newly-released compilers, expand current software offerings, better support GPU-based software, and monitor Lmod module usage to identify unused software packages that can be removed from the software stack. In this work, we discuss the shortcomings of the previous CPE, Spack, and Lmod usage at NCCS, provide further details on the implementation and structure of NSP, then discuss the benefits that NSP provides.

Rentschler, Asa [ORNL] (ORCID:0009000597694743)↗

Java Software Extensibility Library

The Java Software Extensibility Library provides tools that help Java software developers produce flexible and extensible Java applications. The major components include a Plugin Library and a Polymorphic Map data structure. The Plugin Library provides developers with a Plugin Registry and a standard pattern for designing, versioning, registering, retrieving, and annotating plugins. It also enables advanced capabilities such as loading plugins at runtime, and creating/loading encrypted plugin packages. The Polymorphic Map data structure facilitates the storage and retrieval of objects of varying types within a single data structure; while maintaining type safety. The library also provides a standard design pattern for producing application-specific "Domain Maps" and "Closed Domain Maps".SAND2020-3816 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Fleschute, Christopher↗

ellora-spack-gen

The project contains software to analyze the behavior of large language models at code generation tasks. Publicly available information is used to generate Spack package recipes for HPC developers. The software contains orchestration tooling, analysis, and plotting functionality.

Melone, CaetanoN↗

A Robust and Versatile Method of Combinatorial Chemical Synthesis of Gene Libraries via Hierarchical Assembly of Partially Randomized Modules

A major challenge in gene library generation is to guarantee a large functional size and diversity that significantly increases the chances of selecting different functional protein variants. The use of trinucleotides mixtures for controlled randomization results in superior library diversity and offers the ability to specify the type and distribution of the amino acids at each position. Here we describe the generation of a high diversity gene library using tHisF of the hyperthermophile Thermotoga maritima as a scaffold. Combining various rational criteria with contingency, we targeted 26 selected codons of the thisF gene sequence for randomization at a controlled level. We have developed a novel method of creating full-length gene libraries by combinatorial assembly of smaller sub-libraries. Full-length libraries of high diversity can easily be assembled on demand from smaller and much less diverse sublibraries, which circumvent the notoriously troublesome long-term archivation and repeated proliferation of high diversity ensembles of phages or plasmids. We developed a generally applicable software tool for sequence analysis of mutated gene sequences that provides efficient assistance for analysis of library diversity. Finally, practical utility of the library was demonstrated in principle by assessment of the conformational stability of library members and isolating protein variants with HisF activity from it. Our approach integrates a number of features of nucleic acids synthetic chemistry, biochemistry and molecular genetics to a coherent, flexible and robust method of combinatorial gene synthesis.

59 BASIC BIOLOGICAL SCIENCES↗

Cementitious Barriers Partnerships (FY2015 Mid-Year Status Report)

The DOE-EM Office of Tank Waste Management Cementitious Barriers Partnership (CBP) is chartered with providing the technical basis for implementing cement-based waste forms and radioactive waste containment structures for long-term disposal. Therefore, the CBP ultimate purpose is to support progress in final treatment and disposal of legacy waste and closure of High-Level Waste (HLW) tanks in the DOE complex. This status report highlights the CBP 2015 Software and Experimental Program efforts and accomplishments that support DOE needs in environmental cleanup and waste disposal. DOE needs in this area include: Long-term performance predictions to provide credibility (i.e., a defensible technical basis) for regulator and DOE review and approvals, Facility flow sheet development/enhancements, and Conceptual designs for new disposal facilities. In 2015, the CBP plans to release its newest version, the CBP Software Toolbox – “Version 3.0”, which will include new STADIUM carbonation and damage models, a new SRNL module for transport properties and flow in fractured and in-tact cementitious materials, and a new LeachXS/ORCHESTRA (LXO) oxidation module. In addition, improved STADIUM sulfate attack and chloride models will be included. This is in addition to the LXO modules for sulfate attack, carbonation, constituent leaching, and percolation with radial diffusion (for leaching and transport in cracked cementitious materials), of which will also be improved for Version 3.0. These STADIUM and LXO models are applicable and can be used by both DOE and the Nuclear Regulatory Commission (NRC) for service life and long-term performance evaluations and predictions of nuclear and radioactive waste containment structures across the DOE complex. In 2015, the Cementitious Barriers Partnership is providing tangible progress toward fulfilling the objective of developing a set of software tools and experimental programs to improve understanding and prediction of the long-term structural, hydraulic and chemical performance of cementitious barriers used in nuclear applications. To reflect this progress, CBP partners authored and are currently drafting many reports including six papers that were presented at WM2015.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Scientific Computation Application Partnerships in Materials and Chemical Sciences, Charge Transfer and Charge Transport in Photoactivated Systems, Developing Electron-Correlated Methods for Excited State Structure and Dynamics in the NWChem Software Suite

Charge transfer and charge transport in photoactivated systems are fundamental processes that underlie solar energy capture, solar energy conversion, and photoactivated catalysis, both organometallic and enzymatic. We developed methods, algorithms, and software tools needed for reliable treatment of the underlying physics for charge transfer and charge transport, an undertaking with broad applicability to the goals of the fundamental-interaction component of the Department of Energy Office of Basic Energy Sciences and the exascale initiative of the Office of Advanced Scientific Computing Research.

14 SOLAR ENERGY↗

Feature Detection From LiDAR Point Cloud and Aerial Imagery Using Distance Dependent Chinese Restaurant Process [Slides]

It is possible to integrate data captured by UAS from multiple data modalities spatially. We can detect features by combining information across images and LiDAR point clouds. Performance issues exist with the current algorithms in place & could be improved. We hope to test it for at least 500 iterations. Post processing of data takes enormous efforts in case of data generated by proprietary software tools…We intend to develop a better framework for seamless integration.

97 MATHEMATICS AND COMPUTING↗

R3IT, Rapid Rural Resilient Interconnection Toolkit, Final Technical Report

Utilities nationwide are beginning to experience multiple solar interconnection requests per day. This request volume will soon overwhelm utility engineers, especially at smaller utilities which serve the majority of the landmass of the United States. In this project, we developed open-source software tool that automates the interconnection approval process and removes 80% of the time required to approve an interconnection and hence allow more solar to be quickly and safely integrated with the grid. This software is accompanied by a guidebook detailing interconnection best practices and utility lessons learned. Competing solar interconnection software is extremely expensive at ten times the cost of typical distribution engineering tools, it’s closed source which makes it hard to integrate into utility workflows, and it doesn’t address the hardest power flow modeling challenges of interconnection screening. Our solution was built built with our utility partners who are already experiencing multiple interconnection requests per day and integrates best practices from our past work with DOE and the cooperative community on solar integration. The resulting free and open-source solution has been disseminated through our media channels and conferences that engage over 1,900 utilities nationwide.

14 SOLAR ENERGY↗

Practical Multi-Cycle Refueling Simulation of Stable Salt Reactors Based on REBUS Depletion Calculation

A Python software tool ReloadPy has been developed to assistant in formulating online refueling strategies for a family of stable salt reactors. ReloadPy wraps over the legacy fast reactor analysis codes REBUS, DIF3D, and PERSENT. These codes are used to perform single cycle depletion analysis and calculate reactivity worth and power density. ReloadPy determines a refueling assembly position to achieve the user-specified primary objective while satisfying constraints on various performance parameters such as the maximum power density, the maximum reactivity worth of reloaded assembly, and the minimum cycle length. Various capabilities of prescribing refueling sequence or a range of candidate refueling positions and restarting a previous simulation with altered options are implemented to reduce the required user’s efforts to investigate different refueling strategies. This report presents the computational models and methods and also serves as a user guide. Long-term simulation capabilities with different refueling strategies are demonstrated by a series of sample SSR refueling calculations with two-dimensional surrogate core models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

APPROACHES TO GEOMETRIC DATA ANALYSIS ON BIG AREA ADDITIVELY MANUFACTURED (BAAM) PARTS

The promise of additive manufacturing is that a user can design and print complex geometries that are very difficult, if not impossible, to machine. The capabilities of 3D printing are restricted by a number of factors, including properties of the build material, time constraints, and geometric design restrictions. In this paper, a thorough accounting and study of the geometric restrictions that exist in the current iteration of additive manufacturing (AM) fused deposition modeling (FDM) technologies are discussed. Offline and online methodologies for collecting data sets for qualitative analysis of large scale AM, in particular Oak Ridge National Laboratory s (ORNL) big area additive manufacturing (BAAM) system, are summarized. In doing so, a survey of tools for designers and software developers is provided. In particular, strategies in which geometric data can be used as training sets for smarter AM technologies in the future are explained as well.

Dreifus, Gregory D↗

Exploring Ion Mobility Mass Spectrometry Data File Conversions to Leverage Existing Tools and Enable New Workflows

Ion mobility (IM) is often combined with LC-MS experiments to provide an additional dimension of separation for complex sample analysis. While highly complex samples are better characterized by the full dimensionality of LC-IM-MS experiments to uncover new information, downstream data analysis workflows are often not equipped to properly mine the additional IM dimension. For many samples the data acquisition benefits of including IM separations are all that is necessary to uncover sample information and the full dimensionality of the data is not required for data analysis. Post-acquisition reduction and adaptation of the dimensions of LC-IM-MS and IM-MS experiments into an LC-MS format opens the possibility to use a plethora of existing software tools. In this work, we developed data file conversion tools to reduce the complexity of IM data analysis. Three data file transformations are introduced in the PNNL PreProcessor software: 1) mapping the IM axis to the LC axis for IM-MS data, 2) converting the drift time vs. m/z space to CCS/z vs m/z space, and 3) transforming All Ions IM/MS mobility aligned fragmentation data to a standard LC-MS DDA data file format. Finally, these new data file conversions are demonstrated with corresponding lipidomics and proteomics workflows that leverage existing LC-MS data analysis software to highlight the benefits of the data transformations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Commercialization of a Non-Intrusive Optical (NIO) Technology to Measure Heliostat Optical Errors in Utility-Scale Concentrating Solar Power Plants: Final TCF Report

The drone-based Non-Intrusive Optical (NIO) Technology has been developed at NREL to allow for efficient and automated optical characterization of heliostats in Concentrating Solar Power (CSP) plants. For this project, the technology will be developed into a commercial tool package, including software and user-interface (UI), operations manual, and training and support services. The project team will partner with Tietronix to perform market assessment and stakeholder engagement, develop the tool package and business model, and perform data collection and analysis to demonstrate and refine the capabilities for use at a commercial plant. The team will collaborate with a commercial plant to conduct the data collection operations and provide optical error deliverables. The goal of the project is to advance the commercialization of the technology to a stage where a beta version can be demonstrated at additional commercial plants and developed into a licensable product.

14 SOLAR ENERGY↗

Conversion and Validation of Distribution System Model from a QSTS-Based Tool to a Real-Time Dynamic Phasor Simulator

A software process is developed to convert distribution network models from a quasi-static time-series tool (OpenDSS) to a real-time dynamic phasor simulator (ePHASORSIM). The description of this process in this paper would be helpful for researchers who intend to perform similar conversions. The converter could be utilized directly by users of real-time simulators who intend to perform software-in-the-loop or hardware-in-the-loop tests on large distribution test feeders for a range of use cases, including testing functions of advanced distribution management systems against a simulated distribution system. In the future, the developers intend to release the conversion tool as open source to enable use by others.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Position Papers for the ASCR Workshop on the Science of Scientific-Software Development and Use

Software is an increasingly important component in the pursuit of scientific discovery. Both its development and use are essential activities for many scientific teams. At the same time, very little scientific study has been conducted to understand, characterize, and improve the development and use of software for science. Computational science teams have diversified over time to include contributions from domain scientists who provide expertise in scientific and engineering disciplines, applied mathematicians and computer scientists who provide optimal algorithms and data structures, and software and data engineers who provide methodologies and tools adapted and adopted from other software domains. These diverse contributions have enabled tremendous advances in the pursuit of scientific discovery, even as models, computer architectures, and software environments have become more complicated. With this increasing diversity, we believe the next opportunity for qualitative improvement comes from applying the scientific method to understanding, characterizing, and improving how scientific software is developed and used. We believe that this pursuit requires expertise from computational scientists themselves, and from the cognitive and social sciences as well as the software engineering research community. As we look to increase the productivity and sustainability of the scientific-software-development-and-use cycle, a more systematic application of the scientific method to understand processes for software development and use will be a valuable tool to guide future work and result in more usable and sustainable software. This workshop will bring together computer scientists, software engineering researchers, computational scientists, applied mathematicians, social scientists, cognitive scientists, and others, to explore how we can conduct such systematic investigations, what can be learned, and how doing so will benefit the scientific enterprise. The workshop will be structured around a set of breakout sessions, with every attendee expected to participate actively in the discussions. Afterward, workshop attendees — from DOE, industry, and academia — will produce a report for ASCR that summarizes the findings of the workshop.

42 ENGINEERING↗

Sequenceserver: A Modern Graphical User Interface for Custom BLAST Databases

Comparing newly obtained and previously known nucleotide and amino-acid sequences underpins modern biological research. BLAST is a well-established tool for such comparisons but is challenging to use on new data sets. We combined a user-centric design philosophy with sustainable software development approaches to create Sequenceserver, a tool for running BLAST and visually inspecting BLAST results for biological interpretation. Sequenceserver uses simple algorithms to prevent potential analysis errors and provides flexible text-based and visual outputs to support researcher productivity. Our software can be rapidly installed for use by individuals or on shared servers.

59 BASIC BIOLOGICAL SCIENCES↗