Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “automated testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

High tide: a systematic search for ellipsoidal variables in ASAS-SN

ABSTRACT The majority of non-merging stellar mass black holes are discovered by observing high energy emission from accretion processes. Here, we pursue the large, but still mostly unstudied population of non-interacting black holes and neutron stars by searching for the tidally induced ellipsoidal variability of their stellar companions. We start from a sample of about 200 000 rotational variables, semiregular variables, and eclipsing binary stars from the All-Sky Automated Survey for Supernovae. We use a χ2 ratio test followed by visual inspection to identify 369 candidates for ellipsoidal variability. We also discuss how to combine the amplitude of the variability with mass and radius estimates for observed stars to calculate a minimum companion mass, identifying the most promising candidates for high mass companions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Efficient species identification for Pacific salmon genetic monitoring programs

Abstract Genetic monitoring of Pacific salmon in the Columbia River basin provides crucial information to fisheries managers that is otherwise challenging to obtain using traditional methods. Monitoring programs such as genetic stock identification (GSI) and parentage‐based tagging (PBT) involve genotyping tens of thousands of individuals annually. Although rare, these large sample collections inevitably include misidentified species, which exhibit low genotyping success on species‐specific Genotyping‐in‐Thousands by sequencing (GT‐seq) panels. For laboratories involved in large‐scale genotyping efforts, diagnosing non‐target species and reassigning them to the appropriate monitoring program can be costly and time‐consuming. To address this problem, we identified 19 primer pairs that exhibit consistent cross‐species amplification among salmonids and contain 51 species informative variants. These genetic markers reliably discriminate among 11 salmonid species and two subspecies of Cutthroat Trout and have been included in species‐specific GT‐seq panels for Chinook Salmon, Coho Salmon, Sockeye Salmon, and Rainbow Trout commonly used for Pacific salmon genetic monitoring. The majority of species‐informative amplicons (16) were newly identified from the four existing GT‐seq panels, thus demonstrating a low‐cost approach to species identification when using targeted sequencing methods. A species‐calling script was developed that is tailored for routine GT‐seq genotyping pipelines and automates the identification of non‐target species. Following extensive testing with empirical and simulated data, we demonstrated that the genetic markers and accompanying script accurately identified species and are robust to missing genotypic data and low‐frequency, shared polymorphisms among species. Finally, we used these tools to identify Coho Salmon incidentally caught in the Columbia River Chinook Salmon sport fishery and used PBT to determine their hatchery of origin. These molecular and computing resources provide a valuable tool for Pacific salmon conservation in the Columbia River basin and demonstrate a cost‐effective approach to species identification for genetic monitoring programs.

Robinson, Zachary L.↗
DOE OSTI2025

Automated qualification data tool for high temperature metallic materials

This report describes a framework for storing, processing, and displaying qualification data for high temperature mechanical properties. The framework automates the process of generating design data from mechanical test results, for example for a data qualification report for the ASME Boiler \& Pressure Vessel Code. The framework has three parts: a data storage model with common formats for several types of typical mechanical property tests, a backend based on the \pycreep Python library for correlating and extrapolating the data to generate design material properties and allowable stresses, and a demonstration user interface for displaying, sorting, and filtering the data and exploring different options for modeling the design mechanical properties. The report discusses the options available for data processing, with illustrations from real test data on Alloy 617, Alloy 709, Alloy 740H, and Laser-Powder Bed Fusion 316H. The framework is complete for ASME type data analysis and will be used to store test data generated by the Department of Energy, Office of Nuclear Energy, Advanced Materials and Manufacturing Technologies sponsored qualification programs. Future work could extend the tool to other types of material properties and/or expand the demo user interface to make it accessible across the AMMT program.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Performance Evaluation of Distributed Energy Resources Management System via Advanced Hardware-in-the-Loop Simulation: Preprint

This paper presents an advanced hardware-in-the-loop (HIL) platform to evaluate the performance of voltage regulation coordinated across advanced distribution management systems (ADMS), distributed energy management system (DERMS), and DERs. The HIL platform provides realistic laboratory testing, including accurate modeling of the real-world distribution system from a utility partner, real controller (ADMS and DERMs) and power (DERs) hardware, and standard communications protocols. The test results show proper functionalities of the integrated platform and performance of the peak load management of coordinated control systems. Based on the laboratory testing, the utility can set up the same grid automation system to manage DERs to achieve system-level control and operation objectives (e.g., peak load management), thus derisking potential issues (e.g., instability) for field deployment.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Closing the Accuracy Gap in Tandem Photovoltaic Testing: An Accessible and Efficient Spectral Tuning Method Using LED-Based Simulators for Research Laboratories and Industry

Accurate performance calibration of multijunction (MJ) solar cells is critical for advancing this technology toward large-scale terrestrial application, yet existing testing methods developed by photovoltaics calibration laboratories remain prohibitively complex and resource intensive for most research laboratories. Current approaches rely on expensive multisource simulators and/or intricate spectral tuning algorithms, limiting accessibility and hindering standardized comparisons of emerging MJ technologies such as perovskite-based tandems. This paper introduces a streamlined spectral irradiance adjustment method for light-emitting diode (LED)-based solar simulators, which are increasingly adopted in the photovoltaics community due to their versatility and cost-effectiveness. The method we present bins LED channels into groups based on the number of junctions of the MJ photovoltaic device under test (DUT) and their corresponding band gaps and incorporates an automated tuning algorithm that eliminates the need to adjust each channel’s irradiance individually. This tuning algorithm requires the relative spectral responsivities of both the DUT and a broadband reference cell, as well as a calibrated spectroradiometer. Measurement validation across various MJ devices, including III-V and perovskite/silicon tandems, demonstrates excellent agreement within 1% with well-established xenon-tungsten multisource simulators and associated tuning algorithms. By enabling precise spectral tuning with readily available equipment and a simple tuning algorithm, our approach bridges the measurement accuracy gap between research laboratories and accredited testing facilities, fostering more reliable device comparisons and accelerating the translation of MJ technologies into real-world energy systems.

14 SOLAR ENERGY↗
DOE OSTI2023

Assessment of Flow-Enhanced Electrochemical Sensor Testing and Deployments for MSRs

This report serves as the deliverable for Milestone M3RS-23AN0401061 that is part of Work Package RS-23AN040106 (Flow Enhanced Sensors for MSRs – ANL). The goal of this milestone was to determine performance of the flow enhanced electrochemical sensor (FEES) and modular flow instrumentation testbed (MFIT) in safeguards relevant scenarios. Flow enhanced electrochemical sensors are a type of electroanalytical sensor that has been developed at Argonne National Laboratory to be installed directly into MSR flow conduits to make measurements of the salt composition. These sensors represent a significant improvement in capabilities compared to earlier electroanalytical sensors that instead can only be operated in quiescent conditions. Previous work has focused on testing of the FEES in flowing conditions provided by the MFIT to assess the accuracy and precision of the sensor measurements. To further improve this capability, in FY23 we undertook a campaign of safeguards relevant scenarios in molten salt containing a range of uranium chloride concentrations (0 to 3 wt%). All the testing carried out in FY23 was aided by a control system designed to automatically actuate flow conditions and collect data. This new automation system is estimated to have increased experimental throughput by a factor of four and enabled testing in a variety of complex conditions. The advancements in throughput and repeatability led to improved quantification of actinide concentrations using the in-flow sensors, with a reduction of the mean absolute relative error from 5.6% in FY22 to 3.1% in FY23. In addition to safeguards scenarios run in the MFIT, FY23 work included deployment of a FEES at a partner institution where it will be tested in a flowing salt loop. The FEES was successfully integrated into that loop and is being tested prior to loop startup. In FY23, work also continued on the smaller flow system that we have named the mini-MFIT. This smaller system is capable of rapid prototyping of new sensor designs prior to installation in the larger MFIT radiological flow system. Work was carried out to test this new system in non-radiological molten salts in a separate glovebox. This work is helping us to enhance the accuracy of our salt monitoring capabilities through the integration of multiple types of sensors. The high degree of accuracy required by 10 CFR 74 represents a significant challenge, and further design evolution and integration of the sensors into multimodal sensing frameworks will be needed to further push the measurement accuracy to the needed level.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Generating Synthetic Time Series Photovoltaic Data with Real-World Physical Challenges and Noise for Use in Algorithm Test and Validation

The PV Fleet Data Initiative and other projects seek the develop algorithms for automated analysis of PV time series data for extraction of statistical information and other parameters of the data such as degradation rates, soiling loss information, tracker performance, clipping or curtailment, system availability and other valuable information. While there is a vast body of PV data available for application of said extraction algorithms it is difficult to validate these algorithms because the true parameters to be extracted are not known. There has been a wide use of synthetic data in the literature for algorithm validation but this synthetic data is typically very bounded by the problem or topic at hand. The PV Fleet Data Initiative project has demonstrated that real time series PV data almost always includes a host of data quality and physical problems that, in reality, any automated PV abstraction algorithm must handle appropriately. For this reason, this work describes the development of a complex synthetic PV times series data set that includes data quality and physical problems that have been experienced in real world PV data. The various quality and physical problems are documented in the synthetic data so that users can test the validity of various PV extraction algorithms as well as develop new algorithms to solve problems this data set can support.

14 SOLAR ENERGY↗
DOE OSTI2023

Drones, Delivery Robots, Driverless Cars, and Intelligent Curbs for Increasing Energy Productivity of First/Last Mile Goods Movement

The objective of the project is to use empirical testing, life cycle assessment, and systems analysis to research and demonstrate energy improvement when using goods delivery drones, eVTOL, ground delivery robots and automated vehicles compared to a baseline network. The research will also develop proof-of-concept testing, a model, and simulation for a smart curb space as an intelligently-managed urban delivery zone demonstrating additional improvement in energy productivity.

Scherer, Sebastian↗
DOE OSTI2025

Automated Label‐Free Assay for Viral Detection and Inhibitor Screening via Biomembrane‐Functionalized Microelectrode Arrays

Most virus infection assays have indirect readout such as virus number following entry (e.g., PCR, cell lysis). While effective, these technologies are labor‐intensive, require specialized environments (e.g., sterile or RNA‐free), and detect later‐stage viral events like lysis or cell death, lacking sensitivity to early fusion events. To address these limitations, we present biologically relevant 2D membrane materials, host‐cell‐derived supported lipid bilayers (hcd‐SLBs), integrated with organic microelectrode arrays (OMEAs) for detection of severe acute respiratory syndrome coronavirus 2 (SARS‐CoV‐2) fusion. By overexpressing angiotensin‐converting enzyme 2 (ACE2) receptors on the native membranes, the platform functions as a viral sensor capable of detecting virus pseudo particles (VPPs) through the late pathway. Additionally, hcd‐SLBs extracted from human lung epithelium expressing native ACE2 detect fusion events through the early pathway. The platform's utility as a drug‐screening tool is demonstrated by testing antibodies targeting either the ACE2 on the host membrane or the viral spike (S) proteins. To enhance the throughput, microfluidics are integrated for automation and OMEAs are incorporated within each channel, miniaturizing the testing units. This system supports high‐throughput data generation, automation, and scalability, providing an efficient platform for viral fusion detection that advances the study of pathogen‐host interactions and accelerates antiviral drug discovery.

Biology↗
DOE OSTI2022

Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START) – 22323

The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START. A formal series of test routes went through the V&V process from START version 3.2.1 following the implementation of the recommended improvements to START. The V&V of the buffer zone population and distance reported in START were achieved by utilizing a custom workflow developed in QGIS. This platform was chosen because it is fully independent of START. The buffer zone population and route distances in START showed excellent agreement to independent V&V test results. Over 200 route test cases were run; in all cases, the percent difference in the population within the buffer zone was less than +/- 5%, and the majority of cases were below +/- 1%. These cases were also duplicated in ArcMap, which is Environmental Systems Research Institute’s (ESRI) GIS desktop application. The ArcMap results also show good agreement; however, they cannot be considered independent of START because START also uses ESRI software. The V&V tasks are currently addressing population density and estimated radiation dose in START as well as implementing further automation of the V&V process to allow larger suites of test routes to be run more easily and quickly by less experienced GIS users. These improvements to the V&V process will make it a valuable tool for the development team and the stakeholders so that each new iteration of START can easily be checked for quality and consistency. This paper and presentation will describe the V&V process, findings and implications, and ongoing V&V activities.

START, DOE, Transporation, dose, GIS↗
DOE OSTI2025

An Advanced Cyber-Physical System Security Testbed for Substation Automation

A Cyber-Physical System (CPS) testbed serves as a powerful platform for testing and validating cyber intrusion detection and mitigation strategies in substations. This study presents the design and development of a CPS testbed that can effectively assess the real-time dynamics of a substation. Cyber attacks exploiting IEC 61850-based SV and GOOSE protocols are demonstrated using the testbed, along with an analysis on attack detection. Realistic timing measurements are obtained, and the time frames for deploying detection and mitigation strategies are evaluated.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Automation and machine learning drive rapid optimization of isoprenol production in Pseudomonas putida

Advances in genome engineering have improved our ability to perturb microbial metabolic networks, yet bioproduction campaigns often struggle with parsing complex metabolic datasets to efficiently enhance product titers. We address this challenge by coupling laboratory automation with machine learning to systematically optimize the production of isoprenol, a sustainable aviation fuel precursor, in Pseudomonas putida. The simultaneous downregulation through CRISPR interference of combinations of up to four gene targets, guided by machine learning, permitted us to increase isoprenol titer 5-fold in six consecutive design-build-test-learn cycles. Moreover, machine learning enabled us to swiftly explore a vast experimental design space of 800,000 possible combinations by strategically recommending approximately 400 priority constructs. High-throughput proteomics allowed us to validate CRISPRi downregulation and identify biological mechanisms driving production increases. Our work demonstrates that ML-driven automated design-build-test-learn cycles, when combined with rigorous data validation, can rapidly enhance titers without specific biological knowledge, suggesting that it can be applied to any host, product, or pathway.

Carruthers, David N↗
DOE OSTI2020

AFIP6-MkII and RERTR-12 Porosity Data Collection and Analysis for Modeling and Simulation

Gathering data for the improvement of nuclear fuel modeling and simulation efforts is the primary driver for this work. Mechanistic models allow for a better understanding of the material on a micro- and macrostructural level while saving time and money over traditional experiment efforts. Historically, summarized data and correlations are the inputs for empirical material models and model validation. When improving these models for nuclear fuels with experimental results, there is a lack of reliable data readily available. Experiments - RERTR-12 and AFIP6-MkII - were conducted to understand the irradiation behavior of metallic U-10Mo monolithic fuels for use in extreme reactor environments such as research reactors like the Advanced Test Reactor (ATR) or the High Flux Isotope Reactor (HFIR). Microstructural characteristics of fission gas pores (FGP) in each experiment are collected using an automated image analysis technique developed at the University of Florida and presented here. A series of statistical tests are performed to explore the reliability of the results, as well as understand where the data is lacking and what future data collection is necessary to provide sufficient information to assist modeling efforts. The focus is on the porosity, pore size, and eccentricity of FGPs formed during irradiation in three AFIP6-MkII samples and one RERTR-12 sample. From the analysis, it is clear there are substantial impacts of fission density on the pore structure, but there also exist also underlying connections between each sample and the behavior observed in the pores. Further analyses of the pre- and post-irradiation microstructure are needed to improve the understanding of these connections. An early method for microstructural data analysis is presented within and is currently being expanded to include other microstructure data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Autonomous and dynamic precursor selection for solid-state materials synthesis

Abstract Solid-state synthesis plays an important role in the development of new materials and technologies. While in situ characterization and ab-initio computations have advanced our understanding of materials synthesis, experiments targeting new compounds often still require many different precursors and conditions to be tested. Here we introduce an algorithm (ARROWS 3 ) designed to automate the selection of optimal precursors for solid-state materials synthesis. This algorithm actively learns from experimental outcomes to determine which precursors lead to unfavorable reactions that form highly stable intermediates, preventing the target material’s formation. Based on this information, ARROWS 3 proposes new experiments using precursors it predicts to avoid such intermediates, thereby retaining a larger thermodynamic driving force to form the target. We validate this approach on three experimental datasets, containing results from over 200 synthesis procedures. In comparison to black-box optimization, ARROWS 3 identifies effective precursor sets for each target while requiring substantially fewer experimental iterations. These findings highlight the importance of domain knowledge in optimization algorithms for materials synthesis, which are critical for the development of fully autonomous research platforms.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Performance Evaluation of Data-Enhanced Hierarchical Control for Grid Operations

This paper presents a hardware-in-the-loop (HIL) simulation to evaluate the performance of voltage regulation of Data-Enhanced Hierarchical Control (DEHC). This DEHC uses an advanced distribution management system (ADMS) for grid operations to control legacy and grid-edge devices and coordinate with distributed energy management systems (DERMS) to manage high penetrations of photovoltaics (PV) on a utility distribution system. The HIL platform provides realistic laboratory testing, including accurate modeling (legacy devices, grid-edge devices, and PV) of the real-world distribution system from a utility partner, a real controller (ADMS), software controller DERMS, hardware grid-edge devices, and standard communications protocols. The test results demonstrate functionalities of the integrated platform and the performance of voltage regulation of the coordinated control systems. Based on laboratory testing, the utility can set up the same grid-automation system to manage DERs, legacy devices, and grid-edge devices to achieve their system-level control and operation objectives (e.g., voltage regulation), thus de-risking potential issues such as instability for field deployment.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2020

What Questions Would a Systems Engineer Ask to Assess Systems Engineering Models as Credible

Digital Systems Engineering strategies typically call for digital Systems Engineering models to be retained in repositories and certified as an authoritative source of truth (enabling model reuse, qualification, and collaboration). In order for digital Systems Engineering models to be certified as authoritative (credible), they need to be assessed - verified and validated - and with the amount of uncertainty in the model quantified (consider reusing someone else's model without knowing the author). Due to this increasing model complexity, the authors assert that traditional human-based methods for validating, verifying, and uncertainty quantification - such as human-based peer-review sessions - cannot sufficiently establish that a digital Systems Engineering model of a complex system is credible. Digital Systems Engineering models of complex systems can contain millions of nodes and edges. The authors assert that this level of detail is beyond the ability of any group of humans - even working for weeks at a time - to discern and catch every minor model infraction. In contrast, computers are highly effective at discerning infractions with massive amounts of information. The authors suggest that a better approach might be to focus the humans at what model patterns should be assessed and enable the computer to assess the massive details in accordance with those patterns - by running through perhaps 100,000 test loops. In anticipation of future projects to implement and automate the assessment of models at Sandia National Laboratories, a study was initiated to elicit input from a group of 25 Systems Engineering experts. The authors positioning query began with - 'What questions would a Systems Engineer ask to assess Systems Engineering models for credibility?" This report documents the results of that survey.

42 ENGINEERING↗
DOE OSTI2022

Design Requirements and Software Specification for the Autonomous Energy Management Software System for Small Commercial Buildings

Commercial buildings are responsible for approximately 20 percent of the total United States energy consumption and greenhouse gas emissions. Over 85 percent of these buildings lack building automation systems. Many of these buildings are small (<50,000 square feet), underserved, and use rooftop units for heating, ventilation, and air-conditioning needs. Because these buildings lack proper energy management systems, they have several operational deficiencies that lead to excess energy consumption. Studies have shown that managing the rooftop units heating and cooling set points, schedules, setbacks, and optimal start can result in 20 to 25 percent reduction in electricity consumption in small commercial buildings. In addition, improving demand flexibility of these buildings will result additional cost savings for the building owner. Therefore, the Department of Energy’s Building Technologies Office approved a project to address the needs for small commercial buildings. The project is led by Pacific Northwest National Laboratory (PNNL) with Intellimation LLC as the cooperative research and development agreement partner. The primary goal of the project is to develop and validate an autonomous energy management software (AEMS) system that will continuously optimize small commercial building operations by minimizing energy consumption and cost, while providing a solution for maximizing decarbonization benefits from electrification of buildings. The work will leverage the vast experience of PNNL research and development staff who have over two decades of experience in developing and successfully transferring software technologies to the private sector. This solution will be jointly developed with Intellimation, a company that plans to use it to scale their building energy efficiency (EE) and grid services offering. Widespread deployment of the AEMS system will improve the EE and demand flexibility of the building commercial building stock. It should also support cities and states in meeting their climate change mitigation goals. This document describes the various EE and grid service features of the AEMS system, infrastructure and data required to implement those features, and how the features should be automated. It also details how the various features will be tested and validated, including field validation. The document also details what flexibility the users have and how they will be able to leverage those capabilities exercise those. The intent is to create an AEMS system that would support scalable deployment, requires minimal configuration, and is easy to maintain over its expected lifespan. The initial alpha release of AEMS system is planned for March 2023, and the beta release is planned for the summer of 2023. The final release is planned for March 2024. Section 2 of the report documents the relevant building types that AEMS is suitable for. Section 3 documents EE features that will be supported. It will also include the data requirements, hardware requirements, implementation details, and how EE features will be tested and validated. Grid service features will be documented in section 4, including data requirements, hardware requirements, implementation details, and how the services will be tested and validated. Planned next steps are described in section 5.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Performance Evaluation of Hierarchical Controls for Advanced Distribution Management System-Centered Grid Operations: Preprint

This paper presents a hardware-in-the-loop (HIL) platform to evaluate the performance of voltage regulation using an advanced distribution management system (ADMS) for grid operations to control legacy and grid-edge voltage control devices and coordinate with distributed energy management systems (DERMS) to manage high penetrations of photovoltaics (PV) on a utility distribution system. The HIL platform provides realistic laboratory testing, including accurate modeling (legacy devices, grid-edge devices, and PV) of the real-world distribution system from a utility partner, a real controller (ADMS), software controller DERMS, hardware grid-edge devices, and standard communications protocols. The test results show proper functionalities of the integrated platform and the performance of voltage regulation of the coordinated control systems. Based on laboratory testing, the utility can set up the same grid-automation system to manage DERs, legacy devices, and grid-edge devices to achieve their system-level control and operation objectives (e.g., voltage regulation), thus de-risking potential issues (e.g., instability) for field deployment.

ADMS↗