Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Development of the IES Plug-and-Play Framework

This report discusses the status of the flexible plug-and-play framework development currently ongoing that aims to integrate Modelica/Dymola with the Risk Analysis and Virtual ENvironment (RAVEN) software in terms of both Functional Mock-Up Interface (FMI)/Functional Mock-Up Unit (FMU) construction and repository structures that aim to ease the sharing and simulation of complex dynamic models. This report aims to provide an overview of all the performed activities resolving around the deployment of methods, software infrastructures, guidelines and workflow for the construction and usage of models, encapsulated using the FMI/FMU protocols and standards. In particular, the report is organized in three main macro-subjects, which are connected to each other: - FMI/FMU adaptors for modelica models - HYBRID repository new structure and open-source deployment - RAVEN FMI/FMU exporting capabilities and Artificial Intelligence (AI)-based analysis acceleration. The first part of the report discusses the FMI/FMU adaptors that have been created within the HYBRID repository to allow users to quickly export models, such as FMUs. Several examples are shown that highlight the step-by-step process of converting an existing Modelica model into an FMU for use within the Dymola platform. Simulation results demonstrate that, while minor differences may occur, the overall control, trends, and solution integrity are maintained between standard Modelica simulation and FMU simulation results. However, it is worth noting that, for small systems, the FMU results have a slower simulation time than the Modelica only simulation. Using this process, a company can provide models that contain proprietary information to entities without disclosing any of the information about the model that could be considered business sensitive. Such an ability would allow institutions to bypass the necessity of “whitewashing” data. In the second part of the report, the new structure of the HYBRID repository is discussed with a major focus on the series of updates that has been completed. These updates include the addition of Modelica system-level regression tests and software quality assurance documentation that ensure that modifications to the Modelica models do not alter system-level model results. The third and final part of the report aims to report the work that has been performed for the deployment of methods and workflows for the construction of RAVEN AI-based models compliant with the FMI/FMU standard. Such development represents the key for the deployment of the concept of “Flexible ecosystem” since it allows for the replacement of high-fidelity modelica models (or any other FMI/FMU compliant model) with RAVEN generated AI surrogate models. Overall, extensive work has been completed on developing FMUs and FMIs from existing models, understanding the requirements and limitations of FMUs, and open-sourcing the HYBRID repository with an integrated regression system.

14 SOLAR ENERGY↗

Pahute Mesa-Oasis Valley Hydrostratigraphic Framework Model for Corrective Action Units 101 and 102: Central and Western Pahute Mesa, Nye County, Nevada (Rev. 0)

A new, revised three-dimensional (3-D) hydrostratigraphic framework model (HFM) for the Central and Western Pahute Mesa Corrective Action Units 101 and 102 was completed in 2019. The initial (Phase I) model was completed in 2002 and was documented in A Hydrostratigraphic Model and Alternatives for the Groundwater Flow and Contaminant Transport Model of Corrective Action Units 101 and 102: Central and Western Pahute Mesa, Nye County, Nevada (BN, 2002). Subsequent flow and transport modeling revealed the need to collect additional data to reduce uncertainties. The Phase II data collection and characterization effort included extensive well drilling and testing activities, and rebuilding of the Phase I 3-D HFM, resulting in the Phase II HFM (NSTec, 2014). Further drilling (Well ER-20-12), data collection, and interpretive work (e.g., Thirsty Canyon Lineament [Wurtz and Day, 2018]) were incorporated into the Pahute Mesa-Oasis Valley (PM-OV) HFM. The PM-OV HFM incorporates the area of interest from the Phase II HFM and adds additional areas, primarily to the north and west with minor additions to the south and east. The new, expanded area matches the PM-OV groundwater basin as defined in Fenelon et al. (2016) and includes Pahute Mesa, a former nuclear testing area at the Nevada National Security Site; and Oasis Valley, a groundwater discharge area downgradient from contaminant source areas on Pahute Mesa. The data and information necessary to build the PM-OV HFM are provided in Navarro (2019). The PM-OV HFM will be used by hydrologic modelers who are tasked with developing a model to determine how contaminants are transported by groundwater flow in an area of complex geology. The model area is large (more than 6,250 square kilometers) and geologically complex, including Paleozoic- to Mesozoic-age structures (e.g., thrust faults, Thirsty Canyon Lineament), at least seven Tertiary-age calderas, several intrusive bodies, and many relatively recent basin-and-range normal faults. Investigators from the U.S. Geological Survey; National Security Technologies, LLC; National Laboratories; and U.S. Department of Energy contractors have organized the more than 300 volcanic units and other rocks in the model area into 77 hydrostratigraphic units (HSUs). The volcanic rocks are subdivided into 42 aquifers, 11 confining units, and 9 composite units (containing both aquifer and confining unit rocks). The underlying pre-Tertiary rocks were divided into 5 HSUs, comprising 2 aquifers and 3 confining units. The model also includes 1 alluvial aquifer unit, 8 intrusive confining units, and 1 granite confining unit. The model depicts the thickness, extent, and geometric relationships of these HSUs (“layers” in the model) along with all the major structural features that control them, including calderas and faults. The most substantive differences between the Phase II HFM and the PM-OVHFM include (1) addition of the new data and resulting revised interpretations from the additional area encompassed by the PM-OV groundwater basin; (2) incorporation of 16 new faults; (3) 12 boreholes from the northern extension; (4) 2 additional caldera-collapse collars; and (5) correlation of the simulated faulting and hydrostratigraphy in the eastern part of the model domain with the delineations represented in the neighboring Rainier Mesa-Shoshone Mountain HFM-Prime and Yucca Flat-Climax Mine HFM. All PM-OV HFM delineations were based on published and unpublished data from geophysical investigations, surface geologic maps, and drill-hole records. Phase II approached model uncertainty using the model-building software to test model configurations and hydrologic consequences using a range of values for parameters such as fault offset amounts and HSU elevations. The PM-OV HFM expands on this approach to encompass the entire PM-OV groundwater basin.

54 ENVIRONMENTAL SCIENCES↗

FY2021 Improvements to the New CTH Code Verification & Validation Test Suite

Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.

42 ENGINEERING↗

Comparison of steady-state analytical wake models implemented in wind farm analysis software

A common set of mathematical wind turbine wake models are implemented in a few, well-adopted computational tools for wind farm wake modelling. Although the referenced mathematical formulations are common, implementation details may lead to differences in results. This study presents a systematic comparison of the implementation of mathematical wake models in open source, Python-based wind turbine wake modelling software, and a set of the models are directly compared. Despite aligning only the mathematical model parameters and retaining the default computational model parameters, good agreement is found across most of the model implementations, and additional agreement is expected upon further parameters alignment.

17 WIND ENERGY↗

Creating Continuous Integration Infrastructure for Software Development on U.S. Department of Energy High-Performance Computing Systems

The Exascale Computing Project (ECP) software deployment effort developed and advanced DevOps capabilities. One goal was to enable robust continuous integration (CI) workflows that span the protected high performance computing (HPC) environments found within many of the Department of Energy’s (DOE) national laboratories. This article highlights several challenges encountered with enabling automation, such as charging models for CI jobs, and meeting individualized security requirements that revolve around strongly associating running code with a human identity. Here, it also describes how the Jacamar CI tool evolved to meet latter requirements and became a key aspect of the solutions currently offered. Derived from this experience, we offer a conceptual framework for understanding current and future CI challenges at DOE facilities and offer suggestions for long-term solutions.

97 MATHEMATICS AND COMPUTING↗

The Silver Lining

Clouds are shareable scientific instruments that create the potential for reproducibility by ensuring that all investigators have access to a common execution platform on which computational experiments can be repeated and compared. By virtue of the interface they present, they also lead to the creation of digital artifacts compatible with the cloud, such as images or orchestration templates, that go a long way-and sometimes all the way-to representing an experiment in a digital, repeatable form. In this article, I describe how we developed these natural advantages of clouds in the Chameleon testbed and argue that we should leverage them to create a digital research marketplace that would make repeating experiments as natural and viable part of research as sharing ideas via reading papers is today.

Cloud computing↗

Design-to-Deployment Continuum Platform for Microscopes and Computing Ecosystems

Science ecosystems with networked computing systems and physical instruments are increasingly being deployed with a goal to achieve the productivity promised by AI-supported remote automation. In support of these efforts, the virtual infrastructure twins (VITs) have been successfully utilized to develop the orchestration codes for these ecosystems without requiring physical access to expensive instruments, such as electron microscopes. Currently, the utility of such a VIT is severely limited by the computing capacity and capability of the computing system used as its host. Furthermore, codes developed on the VIT typically need to be transferred and refactored for production use, particularly, on high-performance systems with accelerators. In response, we develop a design-to-deployment continuum platform wherein a VIT runs natively on the ecosystem's own computing system, and thereby facilitates the continual in-situ testing and transition of codes for production use. Here, we describe the development and testing of software for remote microscope steering and GPU-based image reconstruction using this platform on a multi-GPU computing system networked to Nion microscopes. We demonstrate a continual transition of steering and reconstruction codes developed under VIT platform to production ecosystem deployment.

Al-Najjar, Anees [Oak Ridge National Laboratory (O↗

Geomagnetically Induced Current Field Test on Large Grid-Connected Power Transformers: Analysis, Model Development, and Simulations

Geomagnetic-induced current (GIC) flow in power grids can cause undesirable effects such as transformer overheating, harmonics, higher reactive power demand, etc. Many simulation models have been developed to study these effects, but real-world verification on modern transformer designs is rare. Here, this paper presents the first long-duration GIC field test in the U.S. performed on high-voltage, grid-connected transformers featuring winding clamps and tie rods instead of conventional tie bars. Field measurements were taken to evaluate GIC effects. These measurements also aided in developing and validating thermal and electromagnetic transient (EMT) models of the transformers. During the test, significant current and voltage distortions were observed along with considerable transformer reactive power losses. Analysis of the field measurements showed that the transformers’ hottest spot was at the inner windings, and their k-factors were close to factory test and software default values. Thermal simulations indicated that the transformers would not violate their thermal limits even for a GIC waveform that peaks at about 200 A/phase. EMT simulations revealed that increased transformer loading may reduce GIC-induced reactive power demand and harmonics in certain scenarios. The study also highlighted potential inaccuracies in using the k-factor method to calculate transformer reactive power losses.

EMTDC↗

Evaluation of Energy Storage Potential of Unconventional Shale Reservoirs Using Numerical Simulation of Cyclic Gas Injection

Compressed air energy storage (CAES) stores energy as compressed air in underground formations, typically salt dome caverns. When electricity demand grows, the compressed air is released through a turbine to produce electricity. CAES in the US is limited to one plant built in 1991, due in part to the inherent risk and uncertainty of developing subsurface storage reservoirs. As an alternative to CAES, we propose using some of the hundreds of thousands of hydraulically fractured horizontal wells to store energy as compressed natural gas in unconventional shale reservoirs. To store energy, produced or “sales” natural gas is injected back into the formation using excess electricity and is later produced through an expander to generate electricity. To evaluate this concept, we performed numerical simulations of cyclic natural gas injection into unconventional shale reservoirs using cmg-gem commercial reservoir modeling software. We tested short-term (diurnal) and long-term (seasonal) energy storage potential by modeling well injection and production gas flowrates as a function of bottom-hole pressure. First, we developed a conceptual model of a single fracture stage in an unconventional shale reservoir to characterize reservoir behavior during cyclic injection and production. Next, we modeled cyclic injection in the Marcellus shale gas play using published data. Results indicate that Marcellus unconventional shale reservoirs could support both short- and long-term energy storage at capacities of 100–1000 kWe per well. The results indicate that energy storage in unconventional shale gas wells may be feasible and warrants further investigation.

25 ENERGY STORAGE↗

Assessment of the Phase-to-Ground Fault Apparent Admittance Method with Phase/Ground Boundaries to Detect Types of Electrical Faults for Protective Relays Using Signature Library and Simulated Events

Protective relays in electric power grids recognize the types of electrical faults in a few seconds. The most common detection method to detect the types of electrical faults is based on measuring the angle between the zero and negative sequence currents. However, it is not completely accurate because the phase-to-phase-ground and phase-to-ground electrical faults could have the same detection conditions. Therefore, engineers need to plot the events after an electrical fault to observe the nature of the incidents in detail. In this study, the phase-to-ground fault apparent (PGFA) admittance method with phase/ground boundaries identified the types of electrical faults located in distribution power lines and feeders. This method was based on measuring the PGFA admittance magnitudes for the faulted and nonfaulted phases, resulting in greater than zero and near zero, respectively. The PGFA admittance algorithm was built with MATLAB/Simulink software and tested with signature library and grid simulation events. The PGFA method with phase/ground boundaries was evaluated with the confusion matrix. The measured and predicted values matched in more than 90% of the tests, and the PGFA admittance method with phase/ground boundaries presented an accuracy of 94.3% and a precision of 100%.

42 ENGINEERING↗

FAUST - Benchmark and Validation Framework [Slides]

This presentation discusses Python packages for nuclear data applications and for benchmarking. It also discusses the goals and objectives for FAUST which include providing input and output processing for different calculation codes, allowing for exchanging results between different applications and codes, running benchmarks and processing the results, automating and simplify plot and report generation, and providing a basis for developing applications useful for nuclear data evaluators. The presentation also discusses how the packages can be used both inside and outside LANL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Transient Data Library of Solar Grid Integrated Distributed System

This submission contains an open-source library of transient events in distributed system with high solar PV. The library includes the collected data, related documents and scripts for loading the data. The data library is built for transient event detection and machine learning based analysis algorithm development. The data was collected via both field test and software simulation. The units for the data are included in the data file headers for each data series. A text editor or spreadsheet software, such as Excel, and Matlab is required to view the data.

algorithms↗

Analysis of Spectral Lines in Large Databases of Synthetic Spectra for Massive Stars

In this paper, we describe a program that identifies in the optical spectrum the main parameters of a spectral line, namely the initial and final wavelengths, and the line depth. Moreover, using numerical calculations, it identifies and removes adjacent lines. Next, the program calculates the equivalent width and the FWHM. The software was tested in a sample of 300 lines in two databases of synthetic spectra generated by the CMFGEN and PoWR codes, and 300 lines in observed spectra from the IACOB database, showing a Gaussian distribution of relative errors, from which it is inferred that 80% of the measured lines have errors less than 17% and only 5% of the lines have errors greater than 26%. The program was also run on the entire database of 45,000 CMFGEN and 202 POWR synthetic spectra, generating a library of H i, He i, and He ii lines necessary to feed the FITspec code for the derivation of stellar parameters: effective temperature, surface gravity, and luminosity.

47 OTHER INSTRUMENTATION↗

Recovering the Star Formation Histories of Recently Quenched Galaxies: The Impact of Model and Prior Choices

Accurate models of the star formation histories (SFHs) of recently quenched galaxies can provide constraints on when and how galaxies shut down their star formation. The recent development of nonparametric SFH models promises the flexibility required to make these measurements. However, model and prior choices significantly affect derived SFHs, particularly for post-starburst galaxies (PSBs), which have sharp changes in their recent SFH. In this paper, we create mock PSBs, then use the Prospector SED fitting software to test how well four different SFH models recover key properties. We find that a two-component parametric model performs well for our simple mock galaxies, but is sensitive to model mismatches. The fixed- and flexible-bin nonparametric models included in Prospector are able to rapidly quench a major burst of star formation, but systematically underestimate the post-burst age by up to 200 Myr. We develop a custom SFH model that allows for additional flexibility in the recent SFH. Our flexible nonparametric model is able to constrain post-burst ages with no significant offset and just ~90 Myr of scatter. Our results suggest that while standard nonparametric models are able to recover first-order quantities of the SFH (mass, SFR, average age), accurately recovering higher-order quantities (burst fraction, quenching time) requires careful consideration of model flexibility. These mock recovery tests are a critical part of future SFH studies. Finally, we show that our new, public SFH model is able to accurately recover the properties of mock star-forming and quiescent galaxies and is suitable for broader use in the SED fitting community. https://github.com/bd-j/prospector

79 ASTRONOMY AND ASTROPHYSICS↗