Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Algorithm testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Benchmarking Optimizers for Qumode State Preparation with Variational Quantum Algorithms

Quantum state preparation involves preparing a target state from an initial system, a process integral to applications such as quantum machine learning and solving systems of linear equations. Recently, there has been a growing interest in qumodes due to advancements in the field and their potential applications. However there is a notable gap in the literature specifically addressing this area. This paper aims to bridge this gap by providing performance benchmarks of various optimizers used in state preparation with Variational Quantum Algorithms. We conducted extensive testing across multiple scenarios, including different target states, both ideal and sampling simulations, and varying numbers of basis gate layers. Our evaluations offer insights into the complexity of learning each type of target state and demonstrate that some optimizers perform better than others in this context. Notably, the Powell optimizer was found to be exceptionally robust against sampling errors, making it a preferred choice in scenarios prone to such inaccuracies. Additionally, the Simultaneous Perturbation Stochastic Approximation optimizer was distinguished for its efficiency and ability to handle increased parameter dimensionality effectively.

Kan, Shuwen [Fordham University]↗

Numerical Solution of the Steady-State Network Flow Equations for a Non-Ideal Gas

Herein we formulate a steady-state network flow problem for non-ideal gas that relates injection rates and nodal pressures in the network to flows in pipes. For this problem, we present and prove a theorem on uniqueness of generalized solution for a broad class of non-ideal pressure-density relations that satisfy a monotonicity property. Further, we develop a Newton-Raphson algorithm for numerical solution of the steady-state problem, which is made possible by a systematic non-dimensionalization of the equations. The developed algorithm has been extensively tested on benchmark instances and shown to converge robustly to a generalized solution. Previous results [1]-[4], indicate that the steady-state network flow equations for an ideal gas are difficult to solve by the Newton-Raphson method because of its extreme sensitivity to the initial guess. In contrast, we find that non-dimensionalization of the steady-state problem is key to robust convergence of the Newton-Raphson method. We identify criteria based on the uniqueness of solutions under which the existence of a non-physical generalized solution found by a non-linear solver implies non-existence of a physical solution, i.e., infeasibility of the problem. Finally, we compare pressure and flow solutions based on ideal and non-ideal equations of state to demonstrate the need to apply the latter in practice. The solver developed in this article is open-source and is made available for both the academic and research communities as well as the industry.

97 MATHEMATICS AND COMPUTING↗

Automatic Waveform Quality Control for Surface Waves Using Machine Learning

Surface-wave seismograms are widely used by researchers to study Earth’s interior and earthquakes. To extract information reliably and robustly from a suite of surface waveforms, the signals require quality control screening to reduce artifacts from signal complexity and noise. This process has usually been completed by human experts labeling each waveform visually, which is time consuming and tedious for large data sets. We explore automated approaches to improve the efficiency of waveform quality control processing by investigating logistic regression, support vector machines, K-nearest neighbors, random forests (RF), and artificial neural networks (ANN) algorithms. To speed up signal quality assessment, we trained these five machine learning (ML) methods using nearly 400,000 human-labeled waveforms. The ANN and RF models outperformed other algorithms and achieved a test accuracy of 92%. We evaluated these two best-performing models using seismic events from geographic regions not used for training. The results show that the two trained models agree with labels from human analysts but required only 0.4% of the time. Although the original (human) quality assignments assessed general waveform signal-to-noise, the ANN or RF labels can help facilitate detailed waveform analysis. Our investigations demonstrate the capability of the automated processing using these two ML models to reduce outliers in surface-wave-related measurements without human quality control screening.

58 GEOSCIENCES↗

Metadata for a systematic description of signal data

This chapter aims to provide a comprehensive overview of metadata types that may be useful during system design, optimization, and automation. Metadata are grouped into three main categories: (a) metadata describing signal generation, (b) metadata describing signal quality, and (c) contextual information in the form of annotations. Each of these categories is introduced and explained in three separate sections. Importantly, this chapter mainly answers what is considered metadata. To a lesser degree, recommendations are made regarding the selection of metadata for long-term storage. Chapter 4 will explain where and how to store metadata. Chapters 5 and 6 explain how to collect certain metadata through dedicated sensor validation tests (Chapter 5) or algorithmic analysis (Chapter 6).

Alferes, Janelcy↗

ARM shortwave spectrometers to study the clear-cloud transition zone and mixing processes

The proposed research is a collaborative effort between NASA/Goddard Space Flight Center and the Hebrew University of Jerusalem. While the NASA team focused on analyzing ground-based hyper-spectral radiance observations to understand cloud edge properties and their connection to mixing processes, the Hebrew University team tackled the problem through cloud modeling activities. By approximating the shortwave spectra in the cloud-clear transition zone as a linear combination of purely clear and purely cloudy spectra we can characterize the variations of cloud optical thickness and cloud droplet effective radius in the transition zone. When applying this method to the measurements of a ground-based shortwave spectroradiometer at the ARM’s SGP site, representing continental conditions, and MAGIC field campaign between Log Angeles, California and Honolulu, Hawaii, representing maritime scenarios, we found that cloud optical depth consistently decreases in both cases, but droplet size decreases much more substantially for the continental regime, suggesting different mixing processes for the continental and maritime conditions. The investigation and measurements of radiation clouds were coupled with a unique cloud modeling. A novel spectral bin microphysics was developed and implemented to the System of Atmospheric Modeling (SAM). In order to resolve cloud transition zones with high spatial gradients of microphysical variables a unique high resolution (10 m) was used in simulations. The model calculates droplet size distributions in each grid point. The model output was transferred to the NASA/GSFC team for utilization in radiative calculations and testing of both radiative algorithm and model representation.

54 ENVIRONMENTAL SCIENCES↗

Physics-Based Real-time Analysis and Control to Achieve Transient-Free Operations for the ITER Era (Final Report)

This is the final report for the early career award for Prof. Egemen Kolemen that aimed to develop the physics and technical basis of real-time transient – i.e. disruptions and Edge Localized Modes (ELMs) – avoidance and feedback control at the DIII-D nuclear fusion facility for the ITER era. During this project, we reconstructed high quality real-time DIII-D equilibria using kinetic information from the motional Stark effect (MSE), Thomson Scattering (TS), and Charge Exchange Recombination (CER) spectroscopy. These equilibria were analyzed in real-time to determine the low-n ideal MHD stability and the pedestal stability thresholds, and to obtain plasma response models. These calculations were used to understand which physical process evolves to lead to the onset of disruption in ITER-relevant scenarios at DIII-D, and how disruption can be predicted using stability analysis as opposed to the current methods of correlation of various signals, which are descriptive but lack predictive power. In the disruption studies, we focused on tearing modes, since these constitute the vast majority of disruptions in this regime. With this knowledge, real-time disruption avoidance algorithms were developed and tested. The enhanced situation awareness and physics insight were used in advanced real-time feedback control of pedestal and core profiles, which allowed the pursuit and sustainment of transient-free high-confinement regimes that cannot be achieved via feed-forward design based on in-between shot analysis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Advanced Laboratory and Field Arrays: Technical Report for Performance Enhancement for Marine Energy Converter (MEC) Arrays (Task 5)

Task 5 consisted of two parts, wave energy converter (WEC) arrays and current energy converter (CEC) arrays. The two parts of the project were executed independently, and this report covers only the work on WECs. In this part of the task, the team characterized the behavior of and developed control schemes for wave energy converter (WEC) arrays that improved performance (i.e., maximized aggregate power generation and reduced the levelized cost of energy) over baseline, non-coordinated control approaches. Specifically, for WEC arrays: the team developed optimal layouts of arrays that considered the effect of WEC placement within an array on coordinated array control with real-time estimation schemes. The numerical codes developed through this task were made available to users for array design. These tools utilized existing commercial software as well as software developed within the project team.

13 HYDRO ENERGY↗

Evaluation and Development of Phase Array Ultrasonic Testing (PAUT) System for Additively Manufactured Parts

This research focuses on the application of advanced ultrasonic testing techniques developed by The Phased Array Company (TPAC) for inspecting defects in additive manufacturing (AM) parts. Traditionally, X-ray computed tomography is the standard for inspecting AM components. Although, the long inspection and analysis time, along with relatively high cost make implementation difficult. Thus, an alternative nondestructive evaluation (NDE) approach is necessary to support quality assurance efforts within the field of AM. TPAC is recognized as a leader in ultrasonic testing innovation, deploying sophisticated algorithms such as Total Focusing Method (TFM) and Phased Wave Imaging (PWI) for ultrasonic data processing and interpretation. This work will explore how the TFM and PWI algorithms can assist defect detection within polymer AM parts. The AM field is seeking novel NDE methods to provide support within quality control and assurance efforts. Advanced ultrasonics inspection have the potential to fulfill this need.

36 MATERIALS SCIENCE↗

A Comprehensive Comparison of Methods for Evaluating Dispatch of Long-Duration Energy Storage in Power Systems Models

Long-duration energy storage (LDES) could play a pivotal role in the transformation of electricity grids with high shares of variable renewable energy (VRE) such as solar and wind. However, the weather-dependent nature of VRE introduces challenges for grid balancing and stability, which LDES - along with short-duration energy storage (SDES) - can help address. However, modeling LDES in production cost models (PCMs) is particularly challenging due to the need for high temporal resolution over extended optimization windows while preserving chronology, which ensures the alignment of energy storage operations with VRE generation over multi-day periods. This report compares traditional dispatch methods with advanced LDES dispatch strategies, such as the extended horizon approach, across different PCM platforms and examines tradeoffs and scalability. The comparison reveals that the traditional 1-day optimization horizon within the PCM leads to inefficient utilization of LDES. In contrast, extending the optimization horizon as much as possible significantly reduces curtailment and improves storage dispatch, especially in renewable-dense systems. There is also promise in using state-of-charge or end volume targets set by an external model, however this requires an additional modeling set and generally increases computational burden. This paper presents a comparison of these various methods in a number of power systems, showing algorithms initially in small test systems and scaling up to large, country-wide simulations. Overall, the research presents the trade-offs of various computational methods and illustrates how LDES may play an essential role in power systems of the future.

14 SOLAR ENERGY↗

Using Machine Learning Algorithm to Detect Blowing Snow and Fog in Antarctica Based on Ceilometer and Surface Meteorology Systems

Blowing snow is a common weather phenomenon in Antarctica and plays an important role in the water vapor cycle and ice sheet mass balance. Although it has a significant impact on the climate of Antarctica, people do not know much about this process. Fog events are difficult to distinguish from blowing snow events using existing detection algorithms by a ceilometer. In this study, based on ceilometer, the meteorological parameters observed by surface meteorology systems are further combined to detect blowing snow and fog using the AdaBoost algorithm. The weather phenomena recorded by human observers are ‘true’. The dataset is collected from 1 January 2016 to 31 December 2016 at the AWARE site. Among them, three-quarters of the data are used as the training set and the rest of the data as the testing set. The classification accuracy of the proposed algorithm for the testing set is about 94%. Compared with the Loeb method, the proposed algorithm can detect 89.12% of blowing snow events and 76.10% of fog events, while the Loeb method can only identify 64.29% of blowing snow events and 31.87% of fog events.

54 ENVIRONMENTAL SCIENCES↗

Simulated JWST Data Sets for Multispectral and Hyperspectral Image Fusion

The James Webb Space Telescope (JWST) will provide multispectral and hyperspectral infrared images of a large number of astrophysical scenes. Multispectral images will have the highest angular resolution, while hyperspectral images (e.g., with integral field unit spectrometers) will provide the best spectral resolution. This paper aims at providing a comprehensive framework to generate an astrophysical scene and to simulate realistic hyperspectral and multispectral data acquired by two JWST instruments, namely, NIRCam Imager and NIRSpec IFU. We want to show that this simulation framework can be resorted to assess the benefits of fusing these images to recover an image of high spatial and spectral resolutions. To do so, we make a synthetic scene associated with a canonical infrared source, the Orion Bar. We develop forward models including corresponding noises for the two JWST instruments based on their physical features. JWST observations are then simulated by applying the forward models to the aforementioned synthetic scene. We test a dedicated fusion algorithm we developed on these simulated observations. We show that the fusion process reconstructs the high spatio-spectral resolution scene with a good accuracy on most areas, and we identify some limitations of the method to be tackled in future works. The synthetic scene and observations presented in the paper can be used, for instance, to evaluate instrument models, pipelines, or more sophisticated algorithms dedicated to JWST data analysis. Besides, fusion methods such as the one presented in this paper are shown to be promising tools to fully exploit the unprecedented capabilities of the JWST.

79 ASTRONOMY AND ASTROPHYSICS↗

AOT_data_repo

Data repo for ocean test case testing new data assimilation algorithm in an idealized setting.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning-Based PV Reserve Determination Strategy for Frequency Control on the WECC System: Preprint

Frequency control from Photovoltaic (PV) plants has great potential to address the frequency response challenge of the power system with high renewable penetration. However, using model-based approaches to determine the optimal PV headroom reserve requires significant online computation and is intractable for an interconnection level system. This paper proposes a machine learning based strategy, that is suitable for real-time operation, to determine the optimal PV reserve for frequency control. The proposed machine learning algorithm is trained and tested on 1,987 offline simulations of a 60% renewable penetration Western Electricity Coordinating Council (WECC) system. Furthermore, the proposed reserve determination strategy is applied on a realistic one-day operation profile of the WECC system and demonstrates over 40% PV headroom saving compared to a conservative approach. It is evident that the proposed strategy can efficiently and effectively determine the optimal PV frequency control reserve for realistic interconnection systems.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Structuring and storing signals with their metadata: practical considerations

This chapter aims to provide a comprehensive overview on structuring signal data and their metadata, highlighting key considerations for optimal management and storage. Specifically, it focuses on: (a) the relevance of data organization; (b) what data to store and what to keep; and (c) data management methods. Thus, this chapter answers where and how to store metadata efficiently. Chapter 3 explains what is considered metadata. Chapters 5 and 6 present how to collect certain metadata through dedicated sensor validation tests (Chapter 5) or algorithmic analysis (Chapter 6).

Nicolaï, Niels↗

Ibis Networks/WattIQ (IN2 Final Report)

Ibis Networks is a full-stack cleantech company that provides plug-level energy monitoring and control to solve energy and asset management problems for the enterprise. During DATES – DATES, an NREL research team worked with the Ibis team to validate their product, the InteliSocket. The Ibis InteliSocket is a pass-through plug-load energy monitor and controller that is designed to reduce energy wasted by common 120 V plug-in devices in commercial office buildings, such as computer peripherals, conference room AV equipment, and break-room appliances. The system can shut off supply power to these end uses via remote control, manual switches, pre-set schedules, or automated control algorithms. The scope of this IN2 project was the development and refinement of “smart” learning behavior algorithms (LBAs), which could help installation processes and dramatically expand the sockets’ capabilities and energy-saving potential by suggesting suitable control schedules that are based on monitored use patterns. While Ibis has the analytical and software expertise for algorithm development, the lack of test data, both in a controlled laboratory setting and in real-life deployment scenarios, represented a key barrier toward commercialization of the product. Assistance through the IN2 program provided an opportunity to conduct the needed “trial and error” algorithm development. The project included baseline field-data collection, laboratory testing, and field validation components, all of which were conducted at the NREL campus between April 2017 and July 2019.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

SNAD transient miner: Finding missed transient events in ZTF DR4 using k-D trees

Here we report the automatic detection of 11 transients (7 possible supernovae and 4 active galactic nuclei candidates) within the Zwicky Transient Facility fourth data release (ZTF DR4), all of them observed in 2018 and absent from public catalogs. Among these, three were not part of the ZTF alert stream. Our transient mining strategy employs 41 physically motivated features extracted from both real light curves and four simulated light curve models (SN Ia, SN II, TDE, SLSN-I). These features are input to a k-D tree algorithm, from which we calculate the 15 nearest neighbors. After pre-processing and selection cuts, our dataset contained approximately a million objects among which we visually inspected the 105 closest neighbors from seven of our brightest, most well-sampled simulations, comprising 89 unique ZTF DR4 sources. Our result illustrates the potential of coherently incorporating domain knowledge and automatic learning algorithms, which is one of the guiding principles directing the SNAD team. It also demonstrates that the ZTF DR is a suitable testing ground for data mining algorithms aiming to prepare for the next generation of astronomical data.

79 ASTRONOMY AND ASTROPHYSICS↗

UNRAVEL: A Robust Modular Velocity Dealiasing Technique for Doppler Radar

Unfold Radar Velocity (UNRAVEL) is an open-source modular Doppler velocity dealiasing algorithm for weather radars. UNRAVEL is an algorithm that does not need external reference velocity data, making it easily applicable. The proposed algorithm includes 11 core modules and 2 dealiasing strategies. UNRAVEL is an iterative algorithm. The goal is to build the dealiasing results starting with the strictest possible continuity tests in azimuth and range and, after each step, relaxing the parameters to include more results from a progressively growing number of reference points. UNRAVEL also has modules that perform 3D continuity checks. Thanks to this modular design, the number of dealiasing strategies can be expanded in order to optimize the dealiasing results. While the first driver dealiases Doppler velocity from each tilt independently from one another, the second driver also performs a three-dimensional continuity check of the velocity using successive elevations. The proposed dealiasing algorithm is tested using severe weather data from an S-band Doppler radar that have been aliased to mimic aliased radial velocity patterns that would be observed by a C-band Doppler radar. Artificially aliasing S-band data permits creation of a reference to which the performance of various dealiasing techniques can be compared. Comparisons show that UNRAVEL consistently outperforms other established dealiasing algorithms for the test period selected in this work.

47 OTHER INSTRUMENTATION↗

Scalable/Secure Cooperative Algorithms and Framework for Extremely-high Penetration Solar Integration (SolarExPert) (Final Technical Report)

This SolarExPert project has developed a Sustainable Grid Platform (SGP) with scalable architecture of distributed control and optimization. The SGP consists of the following major functions: 1) an advanced grid architecture with hierarchical and distributed communication and control, combined with the OpenFMB standard and implemented on the Multi-Agent OpenDSS (MA-OpenDSS) platform; 2) an online distributed stochastic optimal power flow; 3) an online distributed system state estimation algorithm; 4) the distributed Volt/VAR optimization and frequency control algorithms; 5) the distributed distribution system restoration strategy. The developed SGP together with advanced functions are tested in 1 million (1M)-node distribution system on the MA-OpenDSS platform. Furthermore, the models and algorithms are tested in 100,000-node system HiL simulation, and also in P-HiL implementation with 100 physical devices. The developed functions haven been validated and tested on the selected actual distribution feeder with the data collected from the field of Maui Meadows in Hawaii. The distributed PV hosting capacities with cooperative Volt/VAR and Volt/VAR/Watt control are estimated and compared to provide recommendations for customers and the utility company.

14 SOLAR ENERGY↗