Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “automated testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Refrigerator Door-in-Door Opening Controller

Door-in-door refrigerators are becoming increasingly popular on the market. To save energy, items that are most frequently used are stored between doors. Thus only the outer door needs to be opened for access. This invention is used for standard energy performance laboratory tests for these kinds of refrigerators. In conjunction with an automated refrigerator door opener, it allows the refrigerator door opener to open either the outer door only or both inner and outer doors together.

Wang, Duo↗
DOE OSTI2023

Testing SOAR tools in use

Investigations within Security Operation Centers (SOCs) are tedious as they rely on manual efforts to query diverse data sources, overlay related logs, correlate the data into information, and then document results in a ticketing system. Security Orchestration, Automation, and Response (SOAR) tools are a relatively new technology that promise, with appropriate configuration, to collect, filter, and display needed diverse information; automate many of the common tasks that unnecessarily require SOC analysts’ time; facilitate SOC collaboration; and, in doing so, improve both efficiency and consistency of SOCs. There has been no prior research to test SOAR tools in practice; hence, understanding and evaluation of their effect is nascent and needed. Here, in this paper, we design and administer the first hands-on user study of SOAR tools, involving 24 participants and six commercial SOAR tools. Our contributions include the experimental design, itemizing six characteristics of SOAR tools, and a methodology for testing them. We describe configuration of a cyber range test environment, including network, user, and threat emulation; a full SOC tool suite; and creation of artifacts allowing multiple representative investigation scenarios to permit testing. We present the first research results on SOAR tools. Concisely, our findings are that: per-SOC SOAR configuration is extremely important; SOAR tools increase efficiency and reduce context switching, although with potentially decreased ticketing accuracy/completeness; user preference is slightly negatively correlated with their performance with the tool; internet dependence varies widely among SOAR tools; and balance of automation with assisting decision making is preferred by senior participants. We deliver a public user- and tool-anonymized and -obfuscated version of the data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

pyGWBSE: a high throughput workflow package for GW-BSE calculations

Abstract We develop an open-source python workflow package, py GWBSE to perform automated first-principles calculations within the GW-BSE (Bethe-Salpeter) framework. GW-BSE is a many body perturbation theory based approach to explore the quasiparticle (QP) and excitonic properties of materials. GW approximation accurately predicts bandgaps of materials by overcoming the bandgap underestimation issue of the more widely used density functional theory (DFT). BSE formalism produces absorption spectra directly comparable with experimental observations. py GWBSE package achieves complete automation of the entire multi-step GW-BSE computation, including the convergence tests of several parameters that are crucial for the accuracy of these calculations. py GWBSE is integrated with Wannier90 , to generate QP bandstructures, interpolated using the maximally-localized wannier functions. py GWBSE also enables the automated creation of databases of metadata and data, including QP and excitonic properties, which can be extremely useful for future material discovery studies in the field of ultra-wide bandgap semiconductors, electronics, photovoltaics, and photocatalysis.

36 MATERIALS SCIENCE↗
DOE OSTI2022

FLISR in the Presence of DERs ADMS Test Bed Use Case

Fault location, isolation, and restoration (FLISR) is one of the distribution automation applications that utilities are most interested in. It operates groups of switches on distribution feeders to improve the reliability of power delivery after localizing outages. FLISR is an essential function for enabling a self-healing grid, and it directly affects grid reliability and resilience. The presence of DERs brings both new opportunities and challenges for FLISR applications. For instance, some DERs can work as backup generation sources and help energize local networks so more switching options can be achieved with the coordination of FLISR operations; however, the existence of DERs also brings new challenges. The bidirectional power flow resulting from DERs might require dynamic changes to protective devices' fault current settings, and thus the FLISR application will need to dynamically adjust its operations in coordination with the dynamic protection settings. Also, some FLISR applications make their service restoration decisions and close tie-switches based on predefined rules; however, the presence of DERs and their impact on altering net loads on the local feeder network are not considered. For this use case, the project team is using the FLISR application of the Survalent ADMS operating on a real-time simulation of a feeder from Central Georgia EMC, a cooperative electric utility. The performance of the FLISR application is being evaluated for different locations and combinations of DERs, including grid-forming battery energy storage systems.

ADMS↗
DOE OSTI2023

A Workflow for Accelerating Multimodal Data Collection for Electrodeposited Films

Abstract Future machine learning strategies for materials process optimization will likely replace human capital-intensive artisan research with autonomous and/or accelerated approaches. Such automation enables accelerated multimodal characterization that simultaneously minimizes human errors, lowers costs, enhances statistical sampling, and allows scientists to allocate their time to critical thinking instead of repetitive manual tasks. Previous acceleration efforts to synthesize and evaluate materials have often employed elaborate robotic self-driving laboratories or used specialized strategies that are difficult to generalize. Herein we describe an implemented workflow for accelerating the multimodal characterization of a combinatorial set of 915 electroplated Ni and Ni–Fe thin films resulting in a data cube with over 160,000 individual data files. Our acceleration strategies do not require manufacturing-scale resources and are thus amenable to typical materials research facilities in academic, government, or commercial laboratories. The workflow demonstrated the acceleration of six characterization modalities: optical microscopy, laser profilometry, X-ray diffraction, X-ray fluorescence, nanoindentation, and tribological (friction and wear) testing, each with speedup factors ranging from 13–46x. In addition, automated data upload to a repository using FAIR data principles was accelerated by 64x.

36 MATERIALS SCIENCE↗
DOE OSTI2023

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. Furthermore, we observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Path to Automated Validation of ENDF/B-VIII.1 [Slides]

We need to expand the variety of applications to rigorously test libraries. Advanced reactors: – Decreasing reactivity for 8.1b2 compared to 8.0, some unexpected nuclides causing major differences (F-19, Cr), no clear performance difference when compared to experiment. Depletion RCA: – High impact isotopes closer to 7.1 – Small improvement on average (U-5, Pu-9, BC FPs), worse for Am and Cm. Fuel reactivity: – 8.1b2 is higher reactivity at high burnups than 8.0, but likely under predicting k eff for PWRs at high burnup.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Initial demonstration of automated fuel performance modeling with 1977 EBR-II metallic fuel pins using BISON code with FIPD and IMIS databases

Using the BISON fuel performance code, simulations were conducted using an automated process to read initial and operating conditions from the Fuels Irradiation and Physics Database (FIPD) and Integral Fast Reactor materials information system (IMIS) database, which contains metallic fuel data from the Experimental Breeder Reactor-II (EBR-II). This work demonstrates use of an integrated framework to access the vast majority of EBR-II experimental fuel pin data to support rapid development of fuel performance models for next-generation metallic fuel systems. With this capability, validation for fuel qualification can be performed rapidly. Between IMIS and FIPD, there is enough information to conduct 1977 unique EBR-II metallic fuel pin histories from 24 different experiments, at varying levels of detail between the two databases. Each of these histories includes a high-resolution power history, flux history, coolant channel flow rates, and coolant channel temperatures. Fission gas release (FGR), cumulative damage fraction (CDF), fuel axial swelling, cladding profilometry, and burnup were all simulated in BISON. The results were compared to post-irradiation examination (PIE) results for the initial demonstration of automated BISON modeling. BISON simulations conducted with IMIS and FIPD were in rough agreement with PIE measurements and calculations. Cladding profilometry, FGR, and fuel axial swelling were found to be in rough agreement with PIE measurements, depending on the physics used within the BISON input files. Here, the mechanical contact solver chosen was found to significantly impact axial fuel swelling and cladding strain predictions. CDF values were assessed to see whether pin failure may have been predicted (CDF ≥ 1). This work suggests that continued development of an automated tool for BISON should focus on inclusion of the Fast Flux Test Facility (FFTF) experimental data for a larger database for metallic fuel, improved physical models to better capture fuel performance, such as fuel-cladding interactions, and a more detailed comparison with available PIE data to further the BISON model development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Locally adaptive artificial viscosity strategies for Lagrangian hydrodynamics

To accurately model inviscid flow with shock waves using staggered-grid Lagrangian hydrodynamics, artificial viscosity is introduced to convert kinetic energy into internal energy, thereby providing a mechanism to generate the required entropy increase across shocks. In this paper, we propose a new method for constructing an adaptive, artificial viscosity in the context of one-dimensional, staggered-grid Lagrangian hydrodynamics. Our adaptive, artificial viscosity is defined in terms of two parameters that depend on density locally in a neighborhood around a shock, and hence, vary cell-by-cell. Our methodology is based on building a reference set of pre-computed optimal, globally constant artificial viscosity coefficients for a family of isolated shock test problems. For arbitrary flows, the evaluation of the unknown coefficients is automated by first estimating shock intensity locally, and second computing the corresponding adaptive parameter value via interpolation over the data from the pre-computed reference set of optimal, globally constant coefficient values. To illustrate the performance of our new approach, we compare our results against two existing methods. The first method is a limiter-based approach, which relies on estimating velocity gradients of the flow, and the second method is utilized in several commercial codes. Finally, we demonstrate that our new adaptive methodology produces more accurate results for a variety of tests with propagating shock waves, as well as for the aforementioned family of isolated shock problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Assessing the Impact of Variable Air Volume Box Damper Stuck Faults Using a Building Automation System and Building Energy Simulation Model

The study examines the impact of variable air volume (VAV) damper stuck faults on the system operation, building indoor conditions, and reheating energy consumption. This study includes both experimental and simulation studies for five test scenarios, including a fault-free scenario. We implemented VAV damper stuck fault through the building automation system (BAS). Results show that a damper stuck in a high opening position (60% damper opening) results in supplying an excessive amount of cold air from the rooftop unit (RTU) to the conditioned zone, increasing reheating energy consumption. The results of this research can serve as a foundational resource for developing fault detection algorithms.

Jung, Sungkyun↗
DOE OSTI2020

Energy Efficiency Package for Tenant Fit-Out: Laboratory Testing and Validation of Energy Savings and Indoor Environmental Quality

Approximately 40% of the total U.S. office floor space of 1.5 billion sq.m (16 billion sq.ft.) is leased space occupied by tenants. Tenant fit-out presents a key opportunity to incorporate energy efficiency within the real estate business cycle. We designed a package of energy efficiency measures tailored to the scope of a tenant fit-out. This tenant fit-out package (TFP) includes advanced lighting and heating, ventilating and air-conditioning (HVAC) controls as core measures, with ceiling fans, automated shading, and plug load controls as additional optional measures. We conducted laboratory testing of six configurations of the package to evaluate energy savings, indoor environmental quality, and identify installation, commissioning, and operational issues. Combined savings for HVAC, lighting, and plug loads ranged from 33–40%. Lighting savings ranged from 69–83%, and HVAC savings from 20–40%. The laboratory testing also revealed some minor but tractable challenges with installation and commissioning of HVAC controls. Overall, the results demonstrate that significant savings can be realized in existing office buildings by incorporating relatively low-risk, proven measures at the time of a tenant fit-out.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Automated Detection of Instability-Inducing Channel Geometry Transitions in Saint-Venant Simulation of Large-Scale River Networks

A new sweep-search algorithm (SSA) is developed and tested to identify the channel geometry transitions responsible for numerical convergence failure in a Saint-Venant equation (SVE) simulation of a large-scale open-channel network. Numerical instabilities are known to occur at “sharp” transitions in discrete geometry, but the identification of problem locations has been a matter of modeler’s art and a roadblock to implementing large-scale SVE simulations. The new method implements techniques from graph theory applied to a steady-state 1D shallow-water equation solver to recursively examine the numerical stability of each flowpath through the channel network. The SSA is validated with a short river reach and tested by the simulation of ten complete river systems of the Texas–Gulf Coast region by using the extreme hydrological conditions recorded during hurricane Harvey. The SSA successfully identified the problematic channel sections in all tested river systems. Subsequent modification of the problem sections allowed stable solution by an unsteady SVE numerical solver. The new SSA approach permits automated and consistent identification of problem channel geometry in large open-channel network data sets, which is necessary to effectively apply the fully dynamic Saint-Venant equations to large-scale river networks or for city-wide stormwater networks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Abstraction hierarchy to define biofoundry workflows and operations for interoperable synthetic biology research and applications

Lack of standardization in biofoundries limits the scalability and efficiency of synthetic biology research. Here, we propose an abstraction hierarchy that organizes biofoundry activities into four interoperable levels: Project, Service/Capability, Workflow, and Unit Operation, effectively streamlining the Design‑Build‑Test‑Learn (DBTL) cycle. This framework enables more modular, flexible, and automated experimental workflows. It improves communication between researchers and systems, supports reproducibility, and facilitates better integration of software tools and artificial intelligence. Our approach lays the foundation for a globally interoperable biofoundry network, advancing collaborative synthetic biology and accelerating innovation in response to scientific and societal challenges.

Kim, Haseong↗
DOE OSTI2022

Machine-learning for designing nanoarchitectured materials by dealloying

Machine learning-augmented materials design is an emerging method for rapidly developing new materials. It is especially useful for designing new nanoarchitectured materials, whose design parameter space is often large and complex. Metal-agent dealloying, a materials design method for fabricating nanoporous or nanocomposite from a wide range of elements, has attracted significant interest. Here, a machine learning approach is introduced to explore metal-agent dealloying, leading to the prediction of 132 plausible ternary dealloying systems. A machine learning-augmented framework is tested, including predicting dealloying systems and characterizing combinatorial thin films via automated and autonomous machine learning-driven synchrotron techniques. This work demonstrates the potential to utilize machine learning-augmented methods for creating nanoarchitectured thin films.

36 MATERIALS SCIENCE↗
DOE OSTI2020

A semblance measure for model comparison

Algorithmic and computational advances have made it possible that geophysical survey and earth model design can be aided by many systematic trial inverse-modelling runs with synthetic data. Such may, for example, come up in machine-learning approaches. Automated image appraisal pertaining to such applications will involve common statistical tests for goodness-of-data fit as a primary evaluation method. However, solution non-uniqueness may render multiple images equivalent in terms of their data fit, requiring secondary categorizers. A logical choice for classifying synthetic-imaging results quantifies the goodness of model fit where a known reference model replaces the observational input. The task of model intercomparison in terms of measuring the resemblance to the reference model poses challenges to common distance-based metrics like root mean square error and mean absolute error. First, distance-based metrics can introduce spurious contributions when smooth models with fuzzy target contours are to be compared against a sharp reference. Second, large differences due to parameter-estimation overshoots can dominate distance metrics. Here, we propose a remedy that is referred to as semblance and is based on the idea of logistic functions, where a binary-dependent variable adds non-zero or zero accumulation terms for the, respectively, passing or failing of preset target thresholds. This classifying approach is amenable to an objective where model feature recognition is primary. Numerical comparisons to distance-based metrics provide evidence for the advantages of the semblance in view of this objective. Geophysical imaging in conjunction with machine-learning is seen as a benefitting upcoming application area.

58 GEOSCIENCES↗
DOE OSTI2024

Cybersecurity Certification Requirements for Distributed Energy Resources: A Survey of SunSpec Alliance Standards

This survey paper explores the cybersecurity certification requirements defined by the SunSpec Alliance for Distributed Energy Resource (DER) devices, focusing on aspects such as software updates, device communications, authentication mechanisms, device security, logging, and test procedures. The SunSpec cybersecurity standards mandate support for remote and automated software updates, secure communication protocols, stringent authentication practices, and robust logging mechanisms to ensure operational integrity. Furthermore, the paper discusses the implementation of the SAE J3072 standard using the IEEE 2030.5 protocol, emphasizing the secure interactions between electric vehicle supply equipment (EVSE) and plug-in electric vehicles (PEVs) for functionalities like vehicle-to-grid (V2G) capabilities. This research also examines the SunSpec Modbus standard, which enhances the interoperability among DER system components, facilitating compliance with grid interconnection standards. This paper also analyzes the existing SunSpec Device Information Models, which standardize data exchange formats for DER systems across communication interfaces. Finally, this paper concludes with a detailed discussion of the energy storage cybersecurity specification and the blockchain cybersecurity requirements as proposed by SunSpec Alliance.

Tsikteris, Sean (ORCID:0009000524202250)↗
DOE OSTI2024

"Hierarchical Speed Planner for Automated Vehicles: A Framework for Lagrangian Variable Speed Limit in Mixed Autonomy Traffic"

This paper introduces a novel control framework for Lagrangian variable speed limits in hybrid traffic flow environments utilizing automated vehicles (AVs). The framework was validated using a fleet of 100 connected automated vehicles as part of the largest coordinated open-road test designed to smooth traffic flow. The framework includes two main components: a high-level controller deployed on the server side, named Speed Planner, and low-level controllers called vehicle controllers deployed on the vehicle side. The Speed Planner designs and updates target speeds for the vehicle controllers based on real-time Traffic State Estimation (TSE) [1]. The Speed Planner comprises two modules: a TSE enhancement module and a target speed design module. The TSE enhancement module is designed to minimize the effects of inherent latency in the received traffic information and to improve the spatial and temporal resolution of the input traffic data. The target speed design module generates target speed profiles with the goal of improving traffic flow. The vehicle controllers are designed to track the target speed meanwhile responding to the surrounding situation. The numerical simulation indicates the performance of the proposed method: the bottleneck throughput has increased by 5.01%, and the speed standard deviation has been reduced by a significant 34.36%. We further showcase an operational study with a description of how the controller was implemented on a field-test with 100 AVs and its comprehensive effects on the traffic flow.

Wang, Han↗