Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

BootCMatch: A Software Package for Bootstrap AMG Based on GraphWeighted Matching

This article has two main objectives: one is to describe some extensions of an adaptive Algebraic Multigrid (AMG) method of the form previously proposed by the first and third authors, and a second one is to present a new software framework, named BootCMatch, which implements all the components needed to build and apply the described adaptive AMG both as a stand-alone solver and as a preconditioner in a Krylov method. The adaptive AMG presented is meant to handle general symmetric and positive definite (SPD) sparse linear systems, without assuming any a priori information of the problem and its origin; the goal of adaptivity is to achieve a method with a prescribed convergence rate. The presented method exploits a general coarsening process based on aggregation of unknowns, obtained by a maximum weight matching in the adjacency graph of the system matrix. More specifically, a maximum product matching is employed to define an effective smoother subspace (complementary to the coarse space), a process referred to as compatible relaxation, at every level of the recursive two-level hierarchical AMG process. Results on a large variety of test cases and comparisons with related work demonstrate the reliability and efficiency of the method and of the software.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Performance Testing of an Integrated Magnetic Power Take-Off

A wave energy converter (WEC) and the power take-off (PTO) generator system can be represented by using a mass-spring-dampener model. By incorporating a negative stiffness spring within the PTO, the overall stiffness of the PTO can be lowered allowing the impedance of the PTO to be more closely matched with the WEC. By designing for impedance matching the WEC can greatly enhance its power generation capability. This project has involved the design, fabrication and testing of a new type of linear-stroke length and rotary stroke length adjustable negative stiffness magnetic springs for use within a wave energy converter (WEC). The magnetic springs were studied by using 3-D finite element analysis with the objective of creating high energy density and a long linear stroke length. After the construction and testing of both a proof-of-principle adjustable linear and rotary magnetic spring prototype the rotary (torsional) magnetic spring was selected for scaling up analysis. The selected scaled-up proof-of-principle magnetic spring had a peak torque of 850 Nm with a ±45 degree stroke length. By translating the inner rotor relative to the outer rotor, the stiffness could be adjusted to be either negative or positive stiffness. During this project a magnetic lead screw was also studied, and it was shown that by combining the magnetic lead screw with a linearly translating magnetic spring a very long rotary stroke length could be attained. However, as the magnetic lead screw increased complexity and reduced overall energy density relative to a rotary (torsional) spring, this design approach was not further pursed. Dynamometer testing of the variable stiffness magnetic springs was first completed by Portland State University and following this the magnetic spring performance was independently verified by Sandia National Laboratory (Sandia). A WEC analysis when using a variable stiffness magnetic spring was completed by using the WecOptTool. WecOptTool is an open-source WEC optimization software developed by Sandia that supports efficient power take-off (PTO) and control optimization. Wave condition data from the Oregon PacWave test-site was used in this study. The analysis showed that a WEC with a tunable stiffness value could consistently achieve about 80% of its maximum theoretical power production. The use of a tunable stiffness WEC, rather than zero-stiffness or a constant stiffness WEC was also shown to lead to a smaller maximum PTO force requirement. The variable stiffness magnetic spring was integrated into an experimental WEC developed by Sandia, called a Wave-Bot. Sandia successfully completed water-tank testing of the Wave-Bot at the Navy’s Carderock, Maryland, wave-basin test site. The wave-basin testing helped to experimentally demonstrate the operating capabilities and increased power generation capability of a WEC containing an integrated variable stiffness magnetic spring. A WEC capacity factor analysis was also completed. The capacity factor was defined as the ratio of annual average WEC generator power to the maximum (RMS) generated power. This capacity factor provided a means of identifying the ratio of potential revenue to cost. It was calculated that if a tunable variable stiffness magnetic spring has RMS constraints it could operate with a capacity factor above 30%. This is comparable to a wind turbine’s capacity factor.

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

Hardware-in-the-Loop Evaluation of an Advanced Distributed Energy Resource Management Algorithm

This paper presents the laboratory performance evaluation of voltage regulation under a new distributed energy resource management system (DERMS) algorithm via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory environment, including the accurate modeling of a full-scale real-world distribution system from a utility partner, the DERMS software controller, and power hardware photovoltaic (PV) inverters. The new DERMS algorithm is developed based on online multi-objective optimization (OMOO) algorithms that perform fast dispatch of distributed solar PV simulated in a real-time digital simulator and real physical hardware devices. Experimental tests confirm the correct functioning of the HIL platform for evaluating controller algorithms and satisfactory voltage regulation performance of the developed OMOO algorithms.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2026

AFUE Analysis Software Tool

The Annual Fuel Utilization Efficiency (AFUE) analysis of residential and light commercial furnaces follows ANSI/ASHRAE Standard 103-2017 (i.e., Method of Testing for Annual Fuel Utilization Efficiency of Residential Central Furnaces and Boilers) . The analysis is a complex, comprehensive method based on furnace configuration and specific components equipped, requiring detailed furnace testing and measurement data. For this reason, an AFUE Analysis Tool using Microsoft Excel enabled with Visual Basic for Applications (VBA) was developed with a user-friendly interface and comprehensive coverage. The tool consists of three worksheets: unit and configuration selection, geometry and measurement data input, and AFUE plus key results. This tool can be used to estimate the AFUE of both condensing and noncondensing furnaces with single-stage, two-stage, and step-modulating functions. The tool was validated with experimental data from Oak Ridge National Laboratory’s natural gas furnace projects that are commercially available. The results indicate the tool is reasonably accurate in the evaluation of a new R&D modified furnace unit.

Gao, Zhiming [Oak Ridge National Laboratory (ORNL)↗
DOE OSTI2023

SABATH: Surrogate AI Benchmarking Applications' Testing Harness

SABATH provides benchmarking infrastructure for evaluating scientific ML/AI models. It contains support for scientific machine learning surrogates from external repositories. The software dependences are explicitly exposed in the surrogate model definition, which allows the use of advanced optimization, communication, and hardware features.

Luszczek, Piotr [Univ. of Tennessee, Knoxville, TN↗
DOE OSTI2014

Narrowing the gap between the promise and reality of polyketide synthases as a synthetic biology platform

Engineering modular polyketide synthases (PKSs) has the potential to be an effective methodology to produce existing and novel chemicals. However, this potential has only just begun to be realized. We propose the adoption of an iterative design-build-test-learn paradigm to improve PKS engineering. We suggest methods to improve engineered PKS design by learning from laboratory-based selection; adoption of DNA design software and automation to build constructs and libraries more easily; tools for the expression of engineered proteins in a variety of heterologous hosts; and mass spectrometry-based high-throughput screening methods. Finally, lessons learned during iterations of the design-build-test-learn cycle can serve as a knowledge base for the development of a single retrosynthesis algorithm usable by both PKS experts and non-experts alike.

Poust, S↗
DOE OSTI2023

Development and testing of coarse-grained models for ultrasonic simulations of cast austenitic stainless steel

Ultrasonic inspection of cast austenitic stainless steel (CASS) in the nuclear industry is particularly challenging because of sound field scatter and attenuation caused by the coarse-grained microstructure. Modeling and simulation are important tools in ultrasonic testing, as they can be used to help address key aspects of inspections, such as developing new probe designs, predicting inspection reliability, and testing phased-array focal laws. However, developing a useful and reliable CASS model is challenging due to the many grain interfaces and crystalline orientations that must be captured. We demonstrate a method of creating a realistic CASS model that is usable in CIVA, a commercially available modeling and simulation software platform. Using polished and chemically etched sections, we generate models of a coarse-grained equiaxed specimen and a columnar specimen. We also test an alternative method of generating a coarse-grained model using Voronoi regions. We qualitatively compare sound field scatter and quantitatively compare sound field attenuation and beam partitioning in simulated sound fields to those of laboratory-measured sound fields. Results show that the Voronoi models perform as well as or better than the models based on actual grain morphology. Here we also show that model-to-model randomness in Voronoi grain structure can impact the magnitude of a simulated echo response by a factor of two or more. Although CASS models are potentially a good depiction of reality for a given scenario, they should not be considered representative since CASS morphology can change significantly from specimen to specimen or within the same specimen.

36 MATERIALS SCIENCE↗
DOE OSTI2014

A benchmark concept for simulation in radiographic testing

The new standard ISO 17636–2:2013 “NDT of welds: Radiographic testing - Part 2: X- and gamma ray techniques with digital detectors” describes a complex procedure for film replacement by phosphor imaging plates and digital detector arrays. RT modeling software should consider these detector types, X-ray film, and the standard requirements for image quality. Practitioners expect the same visibility of image quality indicators (IQI) in the simulated radiographs as in the experimental exposures. The proposed benchmark test is based on the comparison of experimental radiographs taken at BAM with modeled ones of participants. The experimental setup and the determination of the equivalent penetrameter sensitivity (EPS) as described in the procedure of ASTM E 746 are used for quantitative evaluation of the achievable contrast sensitivity for step hole IQIs as considered in Annex B of ISO 17636–2. System classification data for Computed Radiography (CR) and film systems will be provided by BAM according to ISO 11699–1 for selected film systems and according to ASTM E 2446 for selected CR systems. The classification of films and digital detectors is based on the measurement of the dose response function, the basic spatial resolution (SR{sub b}) of the image, and the measured image noise, which depends on the detector efficiency, the quantum statistics, and the detector fixed pattern noise.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

SITCOMTN-154: Initial studies of photometric redshifts with LSSTComCam from DP1

This technote holds reports based on the first analyses of the Data Preview 1 (DP1) data by the Science Unit for photometric redshifts. Although photometric redshifts are not an official DP1 data product, the "Photo-z Science Unit" generated photo-z estimates for every galaxy in DP1 using the available multi-band imaging on a best-effort basis. This work included developing training and test datasets by matching DP1 data to high-quality reference redshifts obtained with spectroscopy, Grism data, and multi-band photometry. The Science Unit used the RAIL software package to make photometric redshift estimates using eight different algorithms, developed simple scientific performance metrics, used those metrics to explore how the performance of the algorithms varied with configuration changes, derived more optimized configurations of the algorithms and tested the performance of those configurations. This work, the resulting data products and expected data distribution mechanism are all described there.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Near-field passive sensor for the monitoring of high-temperature oxidative corrosion of metals

This study reports on the development and testing of a passive wireless device designed to track temperature and corrosion behavior in SS304H stainless steel under elevated temperatures. The ANSYS HFSS software was utilized to model and optimize the design of an inductor-capacitor (LC) resonator passive wireless sensors fabricated using platinum designs printed onto an aluminum oxide support operating at frequencies between (50–190 MHz). The optimal LC wireless sensor designs were then fabricated using screen-printing and sintering methods. Here, the sensors were tested by placing the sensor onto polished SS304H flat substrates and heated to 900–1050 °C in air. Wireless acquisition of sensor data during heating, cooling, and isothermal stages was achieved through a Pt loop antenna connected to an RF signal generator and a network analyzer.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Evaluating a Commercial Dynamic Line Rating Software with the National PMU Dataset

To accelerate the development of data-driven applications for power systems, the Department of Energy (DOE) supported the collection and curation of a synchrophasor dataset spanning two years of observations from transmission utilities across the US. This National PMU Dataset (NPDS) was anonymized and distributed to awardees of a DOE research grant under nondisclosure agreements (NDAs) but has also been retained at PNNL to enable further research. Agreements with data contributors prevent the data from being shared outside the organization. However, establishing a blind research validation methodology is envisioned to maximize the value proposition of the NPDS. In this validation strategy, researchers may share algorithms/software (potentially as executables to protect intellectual property) with PNNL, and PNNL will share feedback about the software’s performance on subsets of the NPDS. Such a blind methodology ensures that sensitive information about critical infrastructure remains protected, but the value of the NPDS can be extended to research beyond PNNL. Through iterative feedback, the algorithms may be tweaked to address real-world artifacts. As the NPDS data is temporally and geographically diverse, it may capture features absent in smaller datasets used during the development of the algorithm under test. This report presents lessons learned from applying the blind validation methodology to LineID™, a synchrophasor-based dynamic line rating software developed by Topolonet Corporation. Improvements made to the software through iterative feedback, limitations of the validation methodology, as well as how the limitations of the NPDS affected the evaluation process are discussed. Observations indicate that the proposed validation methodology can be valuable for evaluating other tools in the future.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Fracture propagation in Indiana Limestone interpreted via linear softening cohesive fracture model

In this study, we examine the use of a linear softening cohesive fracture model (LCFM) to predict single-trace fracture growth in short-rod (SR) and notched 3-point-bend (N3PB) test configurations in Indiana Limestone. The broad goal of this work is to (a) understand the underlying assumptions of LCFM and (b) use experimental similarities and deviations from the LCFM to understand the role of loading paths of tensile fracture propagation. Cohesive fracture models are being applied in prediction of structural and subsurface fracture propagation in geomaterials. They lump the inelastic processes occurring during fracture propagation into a thin zone between elastic subdomains. LCFM assumes that the cohesive zone initially deforms elastically to a maximum tensile stress ( σ max ) and then softens linearly from the crack opening width at σ max to zero stress at a critical crack opening width w 1 . Using commercial finite element software, we developed LCFMs for the SR and N3PB configurations. After fixing σ max with results from cylinder splitting tests and finding an initial Young's modulus ( E ) with unconfined compressive strength tests, we manually calibrate E and w 1 in the SR model against an envelope of experimental data. We apply the calibrated LCFM parameters in the N3PB geometry and compare the model against an envelope of N3PB experiments. For accurate simulation of fracture propagation, simulated off-crack stresses are high enough to require inclusion of damage. Different elastic moduli are needed in tension and compression. We hypothesize that the timing and location of shear versus extensional micromechanical failures control the qualitative macroscopic force-versus-displacement response in different tests. For accurate prediction, the LCFM requires a constant style of failure, which the SR configuration maintains until very late in deformation. The N3PB configuration does not maintain this constancy. To be broadly applicable between geometries and failure styles, the LCFM would require additional physics, possibly including elastoplastic damage in the bulk material and more complicated cohesive softening models.

58 GEOSCIENCES↗
DOE OSTI2014

SU-E-QI-06: Design and Initial Validation of a Precise Capillary Phantom to Test Perfusion Systems

Purpose: To design a precise perfusion phantom mimicking capillaries of the brain vasculature which could be used to test various perfusion protocols and algorithms which generate perfusion maps. Methods: A perfusion phantom was designed in Solidworks and built using additive manufacturing. The phantom was an overall cylindrical shape of diameter and height 20mm and containing capillaries of 200μm or 300μm which were parallel and in contact making up the inside volume where flow was allowed. We created a flow loop using a peristaltic pump and contrast agent was injected manually. Digital Subtraction Angiographic images and low contrast images with cone beam CT were acquired after the contrast was injected. These images were analyzed by our own code in LabVIEW software and Time-Density Curve, MTT and TTP was calculated. Results: Perfused area was visible in the cone beam CT images; however, individual capillaries were not distinguishable. The Time-Density Curve acquired was accurate, sensitive and repeatable. The parameters MTT, and TTP offered by the phantom were very sensitive to slight changes in the TDC shape. Conclusion: We have created a robust calibrating model for evaluation of existing perfusion data analysis systems. This approach is extremely sensitive to changes in the flow due to the high temporal resolution and could be used as a golden standard to assist developers in calibrating and testing of imaging perfusion systems and software algorithms. Supported by NIH Grant: 2R01EB002873 and an equipment grant from Toshiba Medical Systems Corporation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2018

A SIMPLIFIED ENERGY MODELING APPROACH FOR BUILDINGS

This paper introduces simplified energy modeling (SEM) approaches using DOE2 and EnergyPlus and proposes a validation method for simplified energy modeling. Simplified energy modeling can allow more design teams and owners to leverage the power of energy modeling to inform their designs and lead to greater energy savings and a lower first cost because the technologies and design strategies can be thoroughly tested against models before the decisions are made. By starting a discussion on how to develop simplified energy modeling approaches and methods to validate results, we hope to increase innovation in energy modeling software while decreasing variation between modelers. Simplified modeling is not yet widely accepted because it is unclear if the simplifications reduce the accuracy of the results. By starting an industry dialogue on a testing method for these modeling approaches, we hope to aid adoption of more streamlined tools when they can be shown to provide similar accuracy to more detailed tools. This paper proposes a method to test simplified energy modeling programs against the DOE prototype buildings. It builds on the testing procedure established for simulation engines by ASHRAE Standard 140. By comparing whole building and end use results from the accepted prototype buildings to any simplified modeling approach across multiple building types and climate zones we can determine if the simplifications create unwarranted error. We will present the SEM approach and results for a case study validation for a sample building types in 16 US climate zones from two such simplified energy modeling tools.

Energy Modeling, 90.1 Appendix G, Asset Score Tool↗
DOE OSTI2024

Automating the Analysis of Large Language Models Responses through Zero-Shot Question Answering

Recent advancements in Large Language Models (LLMs) have shown significant potential in various applications, yet their evaluation, particularly in zero-shot question answering scenarios, remains a challenging task. In this study, our objective was to explore precision metrics for Large Language Models (LLM) and design and implement a software pipeline to automatically evaluate LLMs' outputs under zero-shot question answering. Zero-shot question answering involves a model providing answers to questions about topics it hasn't seen during training. It leverages the principles of zero-shot learning by relying on semantic understanding and generalization from related knowledge. The data used was metadata from medical databases on congenital heart disease. We explored eleven LLM metrics and selected three for our evaluation: BLEU, BERTScore, and MoverScore. BLEU calculates a score based on the overlap of n-grams (contiguous sequences of n items, typically words) between the machine-generated translation and the reference translations. Higher BLEU scores indicate better correspondence between the machine-generated and human-generated translations. BERTScore is a metric used to evaluate the quality of machine-generated text by measuring the similarity of token embeddings produced by BERT (Bidirectional Encoder Representations from Transformers) between the generated text and reference text. MoverScore is a metric that quantifies the dissimilarity between the distributions of word embeddings from machine-generated text and reference text, emphasizing semantic similarity over exact token overlap. We also introduced HBKI, a composite metric summarizing these approaches. We tested five models —GPT-3, Llama-2, Gemini 1.5 Pro, Solar 10.7B, and Mixtral-8x7b. Our software pipeline, designed and implemented using Object-Oriented Programming principles, allows users to customize the selection and extraction of features for topics of interest in their own research. Our results show that MoverScore delivered the most precise evaluation of the LLM's outputs, while Mixtral-8x7b achieved the best overall performance in extracting metadata from the databases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

PSpecteR: A User-Friendly and Interactive Application for Visualizing Top-Down and Bottom-Up Proteomics Data in R

Visual examination of mass spectrometry data is necessary to assess data quality and to facilitate data exploration. Graphics provide the means to evaluate spectral properties, test alternative peptide/protein sequence matches, prepare annotated spectra for publication, and fine-tune parameters during wet lab procedures. Visual inspection of MS data is hindered by proprietary proteomics visualization software designed for particular workflows and academic software that lack visualization tools. We built PSpecteR, an open-source and interactive R Shiny web application to address these issues, with support for several steps of proteomics data processing, including: reading various mass spectrometry files, running open-source database search tools, labelling spectra with fragmentation patterns, testing post-translational modifications, plotting where identified fragments map to reference sequences, and visualizing algorithmic output and metadata. All figures, tables, and spectra are exportable within one easy-to-use graphical user interface. Our current software provides a flexible and modern R framework to support fast implementation of additional features. The open source code is readily available (https://github.com/EMSL-Computing/PSpecteR), and a PSpecteR Docker container (https://hub.docker.com/r/emslcomputing) is available for easy local installation.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2022

Seascape Interface Control Document

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source software, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

An Advanced Meso-Scale Peridynamic Modeling Technology using High-Performance Computing for Cost-Effective Product Design and Testing of Carbon Fiber Reinforced Polymer Composites in Light-weight Vehicles

We study a peridynamic composite modeling technology based on the discontinuous Galerkin finite element method, implemented in the commercial LS-DYNA software, for modeling and prediction of failure in carbon fiber reinforced polymer composites. The proposed technology is developed for the material failure analysis at the meso-scale, which provides the prevailing fiber-matrix interaction mechanism, without adoption of the representative volume element method and thus avoiding complicated numerical calibration procedures. Three types of experimental tests—in-plane coupon test, out-of-plane coupon test, and a component crash test—are simulated in a high-performance computing environment to assess the performance of the proposed peridynamic composite modeling technology.

36 MATERIALS SCIENCE↗