Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Data Automata in Scala

The field of runtime verification has during the last decade seen a multitude of systems for monitoring event sequences (traces) emitted by a running system. The objective is to ensure correctness of a system by checking its execution traces against formal specifications representing requirements. A special challenge is data parameterized events, where monitors have to keep track of the combination of control states as well as data constraints, relating events and the data they carry across time points. This poses a challenge wrt. efficiency of monitors, as well as expressiveness of logics. Data automata is a form of automata where states are parameterized with data, supporting monitoring of data parameterized events. We describe the full details of a very simple API in the Scala programming language, an internal DSL (Domain-Specific Language), implementing data automata. The small implementation suggests a design pattern. Data automata allow transition conditions to refer to other states than the source state, and allow target states of transitions to be inlined, offering a temporal logic flavored notation. An embedding of a logic in a high-level language like Scala in addition allows monitors to be programmed using all of Scala's language constructs, offering the full flexibility of a programming language. The framework is demonstrated on an XML processing scenario previously addressed in related work.

runtime verification↗

Demonstration and Verification of Thermo-Mechanical Bowing in a Limited Free-Bow SFR Concept Using MOOSE

Core bowing due to thermal gradients and irradiation induced swelling and creep introduces significant reactivity feedback effects in liquid metal-cooled fast spectrum reactors. During startup, normal operations, and transient events, differential thermal and flux gradients cause expansion, creep, and swelling, which results in bowing in preferential directions depending on local material properties and load-pad and restraint-ring design. The bowing phenomenon produces negative reactivity during accident conditions provided the restraint system has been properly designed to optimally guide the deformation outwards in the active core region. Under the Department of Energy Nuclear Energy Advanced Modeling and Simulation program, a Multiphysics Object Oriented Simulation Environment (MOOSE)-based multiphysics approach to model core bowing is being developed. The present work expands on previous modeling of simpler International Atomic Energy Agency (IAEA) verification problems with these tools by modeling IAEA Verification Problem 4, which involves a symmetric sector of a reactor core with ducted assemblies undergoing differential thermal expansion due to thermal gradients bowing outward with duct-to-duct contact. This model is available on the National Reactor Innovation Center Virtual Test Bed repository. This example was verified against benchmark participant results, which includes bowing deformation evaluation and duct-to-duct interactions at load pads with mechanical contact.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

A research program in advanced information systems

Topics addressed cover: identification of large space structure dynamics; special-purpose architectures for computational fluid dynamics; fault-tolerant processor architectures; data flow techniques; software specification and verification tools; management of software development; software environment for concurrent computing; and parallel algorithms and architectures for the solution of partial differential equations.

Vandervelde, Wallace E.↗

An integrated user-oriented laboratory for verification of digital flight control systems: Features and capabilities

A Digital Flight Control Systems Verification Laboratory (DFCSVL) has been established at NASA Ames Research Center. This report describes the major elements of the laboratory, the research activities that can be supported in the area of verification and validation of digital flight control systems (DFCS), and the operating scenarios within which these activities can be carried out. The DFCSVL consists of a palletized dual-dual flight-control system linked to a dedicated PDP-11/60 processor. Major software support programs are hosted in a remotely located UNIVAC 1100 accessible from the PDP-11/60 through a modem link. Important features of the DFCSVL include extensive hardware and software fault insertion capabilities, a real-time closed loop environment to exercise the DFCS, an integrated set of software verification tools, and a user-oriented interface to all the resources and capabilities.

Defeo, P.↗

ChatPORT: Fine-Tuned LLM for Easy Code {PORT}ing

Fine-tuning existing LLMs for specialized tasks has become a very attractive alternative due to its low cost and quick development cycle. With many pre-trained LLMs available, it is an increasingly complex task to choose the correct model as the starting point or base model. In this work we discuss ChatPORT - a specialized fine-tuned LLM geared towards providing correctly translated codes from one programming model to another. We evaluate a number of base models and compare and contrast their features and characteristics that make them a viable starting point. In this paper, we focus on the OpenMP offload porting capabilities of ChatPORT. We build our training data using kernels from the Heterogeneous Computing Benchmarks (HeCBench) [12] and the OpenMP Validation and Verification suite [5] to fine-tune the base models. We then test the model using unseen kernels extracted from the HeCBench benchmark suite. Our results show that: (1) not all open LLMs geared towards HPC are aware of programming models like OpenMP, (2) although all base models benefit from fine-tuning they learn differently and produce different correctness rates, (3) depending on the memory size and compute resource available, different base models can be used for fine-tuning without significantly affecting the quality of transpiled code they generate, (4) fine-tuning improved the correctness rate of the LLM by an average of 43.2%, and (5) feedback-based training data further increased the correctness rate by an average of 6% over the LLMs tested.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

Replacement of HCFC-225 Solvent for Cleaning NASA Propulsion Oxygen Systems

Since the 1990's, when the Class I Ozone Depleting Substance (ODS) chlorofluorocarbon‐113 (CFC‐113) was banned, NASA's rocket propulsion test facilities at Marshall Space Flight Center (MSFC) and Stennis Space Center (SSC) have relied upon hydrochlorofluorocarbon‐225 (HCFC‐225) to safely clean and verify the cleanliness of large scale propulsion oxygen systems. Effective January 1, 2015, the production, import, export, and new use of HCFC‐225, a Class II ODS, was prohibited by the Clean Air Act. In 2012 through 2014, leveraging resources from both the NASA Rocket Propulsion Test Program and the Defense Logistics Agency ‐ Aviation Hazardous Minimization and Green Products Branch, test labs at MSFC, SSC, and Johnson Space Center's White Sands Test Facility (WSTF) collaborated to seek out, test, and qualify a replacement for HCFC‐225 that is both an effective cleaner and safe for use with oxygen systems. Candidate solvents were selected and a test plan was developed following the guidelines of ASTM G127, Standard Guide for the Selection of Cleaning Agents for Oxygen Systems. Solvents were evaluated for materials compatibility, oxygen compatibility, cleaning effectiveness, and suitability for use in cleanliness verification and field cleaning operations. Two solvents were determined to be acceptable for cleaning oxygen systems and one was chosen for implementation at NASA's rocket propulsion test facilities. The test program and results are summarized. This project also demonstrated the benefits of cross‐agency collaboration in a time of limited resources.

Mitchell, Mark A.↗

Integrating MBSE into Ongoing Projects: Requirements Validation and Test Planning for the ISS SAFER

The International Space Station (ISS) Simplified Aid for Extra Vehicular Activity (EVA) Rescue (SAFER) is the spacewalking astronaut's final safety measure against separating from the ISS and being unable to return safely. Since the late 1990s, the SAFER has been a standard element of the spacewalking astronaut's equipment. The ISS SAFER project was chartered to develop a new block of SAFER units using a highly similar design to the legacy SAFER (known as the USA SAFER). An on-orbit test module was also included in the project to enable periodic maintenance/propulsion system checkout on the ISS SAFER. On the ISS SAFER project, model-based systems engineering (MBSE) was not the initial systems engineering (SE) approach, given the volume of heritage systems engineering and integration (SE&I) products. The initial emphasis was ensuring traceability to ISS program standards as well as to legacy USA SAFER requirements. The requirements management capabilities of the Cradle systems engineering tool were to be utilized to that end. During development, however, MBSE approaches were applied selectively to address specific challenges in requirements validation and test and verification (T&V) planning, which provided measurable efficiencies to the project. From an MBSE perspective, ISS SAFER development presented a challenge and an opportunity. Addressing the challenge first, the project was tasked to use the original USA SAFER operational and design requirements baseline, with a number of additional ISS program requirements to address evolving certification expectations for systems operating on the ISS. Additionally, a need to redesign the ISS SAFER avionics architecture resulted in a set of changes to the design requirements baseline. Finally, the project added an entirely new functionality for on-orbit maintenance. After initial requirements integration, the system requirements count was approaching 1000, which represented a growth of 4x over the original USA SAFER system. This presented the challenge - How to confirm that this new set of requirements set would result in the creation of the desired capability.

Anderson, Herbert A.↗

Spacecraft 2000

The Spacecraft 2000 program has been conceived by NASA with the objective to maintain the U.S. in a strong technical position in the space arena. The program is to involve a cooperative NASA/industry effort with long-range technology development aims. The technology areas addressed are related to spacecraft power, spacecraft energy storage, power management and distribution, autonomous operation-control, onboard systems integration, secondary propulsion, communications technologies, and systems/subsystems technology verification. Aspects of Spacecraft 2000 interactions with industry are discussed, taking into account visitations of NASA personnel to selected industrial concerns, most critical concerns (general), major technical concern, technology drivers for future spacecraft power systems, technology considerations for secondary propulsion, and questions of commercialization. Plans related to a Spacecraft 2000 program formulation are also considered.

Faymon, K. A.↗

Experimental verification of nanometer level optical pathlength control on a flexible structure

This paper describes an experimental facility being developed for demonstration and validation of control concepts arising out of NASA's Control Structure Interaction program. The facility is meant to be a ground testbed with relevance to a broad class of precision optical space systems. The objective of the experimental program is to investigate a multilayer control approach to the maintenance of nanometer-level optical pathlength stability in the presence of external disturbances and multiple structural resonances. The facility is designed to explore the effect of applying, separately and in combinations, structural vibration suppression, vibration isolation, and active optical articulation. This paper describes the testbed facility, the structure, optics, sensors, actuators, and real-time computer and program development environment. Initial optical articulation experimental results are presented.

O'Neal, Michael↗

Subtask 1.3 – Integrated Carbon Capture and Storage for North Dakota Ethanol Production

The Energy & Environmental Research Center (EERC), in partnership with Red Trail Energy, LLC (RTE), a North Dakota ethanol producer; the North Dakota Industrial Commission (NDIC) Renewable Energy Program (REP); and the U.S. Department of Energy (DOE), conducted a feasibility and implementation study for a commercial carbon capture and storage (CCS) effort. This subtask provided technical support and developed recommended practices of how small-scale industrial CO2 emitters (<1,000,000 tonnes of CO2 emitted annually) may economically deploy CCS. The 64-million-gallon dry mill RTE ethanol facility, emitting an average 180,000 tonnes of CO2 annually, was the subject of the case study. The positive outcome of this research, which shows technical and economic potential for ethanol–CCS in North Dakota, has resulted in RTE acquiring an approved Permit to Drill on December 2, 2019, for a stratigraphic test well in early 2020, a necessary step toward a North Dakota CO2 Storage Facility Permit (SFP) for the RTE CCS effort. Outcomes include 1) validating the Broom Creek Formation as a regional target for CCS, 2) determining the full carbon life cycle of an industrial fuel production facility with CCS, 3) developing a field implementation plan (FIP) for small-scale CCS, and 4) determining the validity and pathway for using CCS to meet low-carbon fuel (LCF) standards. The technical team included the EERC, RTE, Trimeric Corporation, Schlumberger Carbon Services, and Computer Modelling Group (CMG). Findings from activities conducted November 2016 – May 2020 are summarized as follows. Several key steps have been accomplished toward validating the Broom Creek Formation as a CO2 injection and storage target at the RTE CCS site, including verification of the presence and structure of sandstone layers that may comprise the potential CO2 storage reservoir and the several thousand feet of overlying confining zone. Work included site characterization using existing data, interpretation of seismic data within the study area, and geologic modeling simulation of CO2 injection. Interpreted results estimate 3000 feet of confining zone between the Broom Creek Formation (storage target) and the lowermost underground source of drinking water (e.g., the Fox Hills Formation). The thickness of the Broom Creek injection target varies 230–420 ft within the survey area. Results were used to inform the location of a stratigraphic test well and associated characterization test program. No impediments were identified within the targeted CO2 storage complex that would prevent the project from moving forward. A stratigraphic test well is the next step to validate these results and to acquire remaining data necessary to develop a North Dakota CO2 SFP application. The EERC generated full carbon life cycle estimates for CCS integration with the RTE ethanol facility. Results indicated that an average 40% reduction in CO2 emissions is possible through CCS implementation. Approximately half of the carbon in the overall life cycle for a dry mill ethanol plant is generated through the fermentation process and emitted to the atmosphere; this is the CO2 stream targeted for CCS. The remaining carbon is attributed to corn feedstock farming (diesel, fertilizer), energy for fuel processing (natural gas, electricity), and transportation (diesel) of the fuel product. Life cycle carbon estimates are also affected by the anticipated energy consumption of a potential capture facility, which depend on the type of CO2 product generated. For example, a 30%–40% net CO2 emission reduction is estimated if a liquefied CO2 facility were incorporated compared to a 40%–50% net CO2 reduction if a supercritical “injection-grade” CO2 product is generated; i.e., more energy is required to further refine the CO2 stream, affecting the full carbon life cycle estimates. A CCS FIP was developed and initiated at the RTE CCS site, resulting in the development of several guidance documents: a CO2 Capture Process Design Package, a North Dakota CO2 geologic Storage Permits Template, and a Public Outreach Package for CCS in North Dakota. General FIP components include CO2 capture system, pipeline and well designs; monitoring, verification, and accounting (MVA) plans; geologic characterization and testing programs; and permitting and outreach plans. Vendor bids were also acquired for the CO2 liquefaction facility. Near-surface characterization (groundwater and soil gas sampling) and geologic characterization (seismic survey) were initiated to inform development of a UIC Class VI-compliant MVA plan compliant with a North Dakota CO2 SFP. Designs (well and geologic testing) were completed for a stratigraphic test well compliant with a North Dakota CO2 SFP. In addition, the outreach plan was executed, including community open houses, meetings with city/county/state officials, and development of public materials. Although other entities continued to mature incentive programs in 2019–2020, California and the Internal Revenue Service (IRS) currently provide the most advanced economic opportunities for CCS integrated with fuel production. The California Low-Carbon Fuel Standard (LCFS) adopted a CCS Protocol in January 2019, allowing submittal of a design-based pathway (DBP) application for an approved temporary (not certified) carbon intensity value for a fully engineered facility. An ethanol–CCS DBP application to the California LCFS Program (officially approved February 28, 2020) was developed to show that the RTE CCS effort meets LCFS requirements. The approved DBP provides confidence to advance the project and supports potential investments. Other entities continue to mature incentive programs. The IRS issued guidance in February 2020 that addresses the definition of beginning of construction and revenue procedure on partnerships for the Enhancement of Carbon Dioxide Sequestration Credit (a.k.a. Section 45Q) CCS tax credit program; the IRS anticipates issuing further guidance on issues such as secure geologic storage, utilization qualifications, and recapture of claimed credits. Maturing incentive programs coupled with workable permitting regulations provide confidence to advance CCS projects in North Dakota and support financial investment to proceed with designing, constructing, and implementing CCS projects at small-scale fuel production facilities. The largest hurdles for CCS implementation at small-scale industrial systems are often business/economic-related (i.e., not technical). Market uncertainty already exists for agriculture-based alternative fuels such as corn ethanol, for which production has increased by ~33%, and prices have correspondingly lowered since 2015. Passing the Section 45Q tax credit program improves economic feasibility for CCS but may require external investors for a small business to achieve maximum benefits. Public–private partnerships with NDIC and DOE have resulted in foundational technical and regulatory knowledge, growing stakeholder confidence, and a pathway to implementation that enables similar industrial CCS projects in the region to advance. This subtask was funded through the EERC–DOE Joint Program on Research and Development for Fossil Energy-Related Resources Cooperative Agreement No. DE-FE0024233. Nonfederal funding was provided by NDIC and RTE. The authors would also like to thank CMG, ESRI, IHS, Neuralog, and Schlumberger for allowing the use of their software packages in support of this work.

42 ENGINEERING↗

Requirements Description of DASSH-F

This report reviews the modeling and simulation capabilities of Argonne National Laboratory’s DASSH code that is used in present reactor analysis activities. These capabilities will be used to establish the set of verification tasks necessary to verify DASSH for use on commercial projects. A similar approach was taken for the PERSENT, REBUS and DIF3D software packages. The DASSH program is a thermal analysis code designed to rapidly allow a reactor design engineer to obtain flow rates requirements that satisfy peak temperature constraints in the domain. DASSH is a follow-on development to the SE2-ANL software and SUPERENERGY-2 software that it is based upon. DASSH was designed to account for both neutron and gamma heating and is inherently connected to the GAMSOR part of the ARC suite of fast reactor analysis software. SE2-ANL is a developed piece of software from the 1980s while DASSH is a modern implementation with notable improvements in geometry handling. The most important upgrade of DASSH relative to SE2-ANL is that it can analyze multiple time points in a single run where SE2-ANL can only treat a single time point. This allows the user to understand the impact of and search the flow distribution for the entire operational period of a reactor design considering pressure drop, peak coolant and fuel temperatures, and thermal striping. DASSH has three input paths that have to be verified. The first input path builds the geometry and power distribution based upon the DIF3D model but ignores the gamma heating aspects of the problem. The second input path also builds the geometry from the DIF3D model but it takes the neutron and gamma heating distributions from GAMSOR. The third input path is to take the geometry and power distribution directly from user input (i.e. not coupled to DIF3D or GAMSOR). DASSH also has many built in correlations for material properties along with a user defined specification of the fuel, structure, and coolant properties. There are correlations for flow split, mixing, pressure drop, and heat transfer coefficients (subchannel rather than a direct methodology). In total, verification of DASSH will require an extensive testing to cover all possible user features of the software.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗

NEAMS Advanced Reactor Model Contributions to the NRIC Virtual Test Bed

The U.S. Department of Energy (DOE) Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program develops models of advanced reactor phenomena to demonstrate code applicability to challenging physics problems, drive code development through user assessment, and perform code verification and validation. Meanwhile, the U.S. DOE’s National Reactor Innovation Center (NRIC) hosts an open-source website and associated GitHub repository called the Virtual Test Bed (VTB) on which computational models for advanced reactors are documented and shared with the reactor community. Several NEAMS advanced reactor models (including input files, documentation, and discussion of results) have recently been contributed to the NRIC VTB. The open sharing of these models benefits the reactor community by providing “best practice” examples using NEAMS tools for advanced reactor physics problems. This report summarizes and provides links to these new models, which include modeling phenomena important to liquid metal cooled fast reactors, molten salt reactors, high temperature gas-cooled reactors, and microreactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

FAUST - Benchmark and Validation Framework [Slides]

This presentation discusses Python packages for nuclear data applications and for benchmarking. It also discusses the goals and objectives for FAUST which include providing input and output processing for different calculation codes, allowing for exchanging results between different applications and codes, running benchmarks and processing the results, automating and simplify plot and report generation, and providing a basis for developing applications useful for nuclear data evaluators. The presentation also discusses how the packages can be used both inside and outside LANL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

MCNP6.3: A Year in Review [Slides]

This presentation discusses the past year and the many accomplishments of the MCNP6.3 team. It states that the MCNP6.3 release is imminent and that the approved, final documents have been making their way to the website. The code executables and source are already packaged up for distribution and the new installer is being finalized and tested now, for all platforms. The package will be sent to RSICC before the end of October 2022. Additionally, the presentation discusses some things to think about as MCNP6.3 is requested and/or used. For example, many of the recent efforts have been focused on making development, updates, and distribution of the code and documents more robust and streamlined. They will be revising/updating documents more frequently than ever before and they will be exploring avenues to distribute official patches to MCNP6.3. As they explain, this allows them to be more responsive to bugs and issues that are identified. In conclusion, the application of a patch to MCNP6.3 will require having the source code.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

NEAMS Model Contributions in 2023 to the National Reactor Innovation Center Virtual Test Bed for Use by Industry and Other Stakeholders

The U.S. Department of Energy (DOE) Office of Nuclear Energy’s Advanced Modeling and Simulation (NEAMS) Program develops models of advanced reactor phenomena to demonstrate code applicability to challenging physics problems, drive code development through user assessment, and perform code verification and validation. Meanwhile, the U.S. DOE’s National Reactor Innovation Center (NRIC) hosts an open-source website and associated GitHub repository called the Virtual Test Bed (VTB) on which computational models for advanced reactors are documented and shared with the reactor community. This work documents NEAMS efforts to support industry adoption of advanced modeling tools through contribution of 10 NEAMS models to the NRIC Virtual Test Bed including models for the High Temperature Test Facility (HTTF), TRISO fuel failure in a microreactor, and multiphysics models of a molten chloride fast reactor, among others. The open sharing of these models benefits the reactor community by providing “best practice” examples using NEAMS tools for advanced reactor physics problems. In particular, the HTTF model is being used for code validation and benchmarking activities. The microreactor and molten chloride fast reactor models are representative of analysis that may be useful for current candidates of DOME and LOTUS, NRIC’s physical testbeds. This report summarizes and provides links to these new models, among others.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Cluster man/system design requirements and verification

Discussion of the procedures employed for determining the man/system requirements that guided Skylab design, and review of the techniques used for implementing the man/system design verification. The foremost lesson learned from the design need anticipation and design verification experience is the necessity to allow for human capabilities of in-flight maintenance and repair. It is now known that the entire program was salvaged by a series of unplanned maintenance and repair events which were implemented in spite of poor design provisions for maintenance.

Orbital workers↗

Evidence flow graph methods for validation and verification of expert systems

This final report describes the results of an investigation into the use of evidence flow graph techniques for performing validation and verification of expert systems. This was approached by developing a translator to convert horn-clause rule bases into evidence flow graphs, a simulation program, and methods of analysis. These tools were then applied to a simple rule base which contained errors. It was found that the method was capable of identifying a variety of problems, for example that the order of presentation of input data or small changes in critical parameters could effect the output from a set of rules.

Becker, Lee A.↗