Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Optomechanical Alignment of the Grating Wheel Mechanism for a Ground-based, Cryogenic, Near-Infrared Astronomy Instrument

We describe the population, optomechanical alignment, and alignment verification of near-infrared gratings on the grating wheel mechanism (GWM) for the Infrared Multi- Object Spectrometer (IRMOS). IRMOS is a cryogenic (80 K) facility instrument for the Mayall Telescope (3.8 m) at Kitt Peak National Observatory and a MEMS spectrometer concept demonstrator for NASA's James Webb Space Telescope. The IRMOS optics, bench, and mechanisms are predominantly made of Al 6061 -T651. The GWM consists of 13 planar diffraction gratings and one flat imaging mirror (58 x 57 mm), each mounted at a unique compound angle on a 31.8 cm diameter gear. The Al 6061 grating substrates are stress relieved for enhanced cryogenic performance and the optical surface is replicated from an off-the-shelf master. The imaging mirror is diamond turned and post-polished. The grating mechanism spans a projected diameter of approximately 48cm when fully assembled, utilizes several flexure designs throughout the system to accommodate thermal gradient situations, and is controlled using custom software with an off-the-shelf controller. Each optic is aligned in six degrees of freedom relative to the GWM coordinate system, which is defined relative to an optical alignment cube mounted at the center of the gear. The tip/tilt (Rx, Ry) orientation of a given grating is measured using the zero-order return from an autocollimating theodolite. Each optic's mount includes a one-piece shim located between the optic and the gear. The shim is machined to fine align each optic. We also describe alignment verification, where grating diffractive properties are compared to model predictions.

Gutkowski, Sharon M.↗

SU-E-T-269: Quality Assurance of Spine Volumetric Modulated Arc Therapy with Flattening Filter Free Beams Using Gafchromic EBT3 Films

Purpose: We implemented the Gafchromic film-based patient specific QA of volumetric modulated arc therapy (VMAT) with flattening-filter free (FFF) beams for spine metastases and validated the accuracy of fast arc delivery. Methods: EBT3 films and a homemade cylindrical QA phantom were employed for dosimetric verification of VMATs. For 14 FFF VMAT plans (10 with 10-MV FFF beams and 4 with 6-MV FFF beams), the doses were recalculated on the phantom and delivered by a TrueBeam STx accelerator equipped with a high-definition 120 leaf MLC. The EBT3 films were scanned using an Epson 10000XL scanner through the FilmQA Pro software. All the irradiated film images were converted to dose map using a calibration response curve. The resulting dose map of film measurement was compared with treatment plan and evaluated using gamma analysis with dose tolerance of 2% within 2 mm. In addition, the point-dose measurement in the phantom using an ion chamber was evaluated as a reference in a ratio of measured and planned doses. Results: The gamma pass rates averaged over all FFF plans for composite-field measurements were 96.0 ± 3.6% (88.9%–99.5%). When adopting a tolerance level of 3% - 3 mm, the gamma pass rates were improved with the ranges from 98% to 100%. In addition, dose profiles and dose distributions showed that spinal cord was protected by the rapid dose fall-off and by delivering the treatment with high precision. In point-dose measurements, the average differences between the measured and planned doses were 0.5% ± 1.0% of the prescription dose. Conclusion: We demonstrated that Gafchromic EBT3 film would be an effective patient-specific QA tool, especially for VMAT of spine SBRT with treatment of small fields and highly gradient dose distributions. The results of film QA verified that the dosimetric accuracy of spine SBRT utilizing RapidArc with FFF beams in our institution is reliable.

60 APPLIED LIFE SCIENCES↗

Control system testing

A three stage process of ground testing of the Space Telescope Pointing Control System is used for verification prior to on-orbit operation. First, development tests are conducted in a laboratory environment using flight/engineering model control sensor and actuators configured with an engineering model of the flight computer and data management system breadboards. These development tests validate the results of computer simulations predicting control system performance. Integration tests bring together flight system elements and software interfaced to a software simulation of vehicle dynamics to confirm closed loop performance. The final ground test phase, flight systems testing, is conducted on the fully assembled Space Telescope, verifies interfaces with the Fine Guidance Sensors and includes a thermal vacuum testing period. During the final test phase, the Point Control System is exercised with the dynamics simulator running in real time.

Whittler, W. H.↗

Formalizing procedures for operations automation, operator training and spacecraft autonomy

The generation and validation of operations procedures is a key task of mission preparation that is quite complex and costly. This has motivated the development of software applications providing support for procedures preparation. Several applications have been developed at MATRA MARCONI SPACE (MMS) over the last five years. They are presented in the first section of this paper. The main idea is that if procedures are represented in a formal language, they can be managed more easily with a computer tool and some automatic verifications can be performed. One difficulty is to define a formal language that is easy to use for operators and operations engineers. From the experience of the various procedures management tools developed in the last five years (including the POM, EOA, and CSS projects), MMS has derived OPSMAKER, a generic tool for procedure elaboration and validation. It has been applied to quite different types of missions, ranging from crew procedures (PREVISE system), ground control centers management procedures (PROCSU system), and - most relevant to the present paper - satellite operation procedures (PROCSAT developed for CNES, to support the preparation and verification of SPOT 4 operation procedures, and OPSAT for MMS telecom satellites operation procedures).

Lecouat, Francois↗

Synthetic Scene Generation of Stennis Target Range for the Calibration of Remote Sensing Systems

The validation and verification (V&V) target range developed at Stennis Space Center is a useful tool for the calibration of remote sensing systems. In this paper, we present an algorithm for generating synthetic scenes or digital models of this target range. The atmospheric radiative transfer code Modtran 4 is used in simulating at-sensor radiance for a given sensor. Software is developed to generate the scene with different spatial and spectral resolutions using the at-sensor radiance values. Synthetic scenes provide a cost-effective way for in-flight validation for the spatial and radiometric accuracy of the data. Other applications include mission planning, sensor simulation, and trade-off analysis in sensor design. The radiometric and spatial accuracy of the simulation is evaluated by comparing simulated scenes with AVIRIS acquired values.

Cao, Chang-Yong↗

Flux in a 1D-Reactor Cell by Response Matrix

Legacy computational reactor physics software tools and protocols currently used in support of the Advanced Test Reactor (ATR) core fuel management and safety assurance, and to some extent, experiment management, are inconsistent with the state of modern nuclear engineering practice. Thus, they are difficult, if not impossible, to verify and validate (V and V) according to modern standards. Furthermore, the legacy staff knowledge required for effective application of their application and protocols from the 1960's and 1970's is rapidly being lost due to staff turnover and retirements. In late 2009, the Idaho National Laboratory (INL) initiated a focused effort, the ATR Core Modeling Update Project, to address this situation through the introduction of modern high-fidelity transport theory based computational software and models to replace the legacy methods, with appropriate (V and V) protocols according to applicable national standards. The new computational tools include: - The 2-dimensional HELIOS deterministic transport code for integrated ATR core fuel and experiment management and Core Safety Analysis Package (CSAP) physics data generation. The MCNP5 3-dimensional stochastic simulation (Monte Carlo) code for verification and validation applications and for specialized ATR core analysis along with its longstanding traditional role in experiment support - The 2-dimensional deterministic NEWT transport code and the 3-dimensional KENO6 stochastic simulation code, with their SCALE-based support infrastructure for use in V and V applications and as supporting modules for sensitivity-uncertainty analysis via the TSUNAMI system. The ATTILA 3-dimensional discrete-ordinates transport code for specialized experiment support and possibly additional applications. Regardless of application, every neutron transport code, new or legacy, requires verification. The aim of this presentation is to provide a neutron transport benchmark for a simple 1D-reactor cell in plane geometry. The benchmark finds use as a standard of comparison for the codes listed above intended for the ATR upgrade. The method developed here is in contrast to the finite Fourier transform solution found in Ref. 1, which is limited to isotropic scattering and particularly difficult to numerically implement unless the total cross section is constant over the cell.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SU-E-T-67: A Quality Assurance Procedure for VMAT Delivery Technique with Multiple Verification Metric Using TG-119 Protocol

Purpose: A successful VMAT plan delivery includes precise modulations of dose rate, gantry rotational and multi-leaf collimator shapes. The purpose of this research is to construct routine QA protocol which focuses on VMAT delivery technique and to obtain a baseline including dose error, fluence distribution and mechanical accuracy during VMAT. Methods: The mock prostate, head and neck (HN) cases supplied from AAPM were used in this study. A VMAT plans were generated in Monaco TPS according to TG-119 protocol. Plans were created using 6 MV and 10 MV photon beams for each case. The phantom based measurement, fluence measurement and log files analysis were performed. The dose measurement was performed using 0.6 cc ion chamber, which located at isocenter. The fluence distribution were acquired using the MapCHECK2 mounted in the MapPHAN. The trajectory log files recorded inner 20 leaf pairs and gantry angle positions at every 0.25 sec interval were exported to in-house software developed by MATLAB and determined those RMS values. Results: The dose difference is expressed as a ratio of the difference between measured and planned doses. The dose difference for 6 MV was 0.91%, for 10 MV was 0.67%. In turn, the fluence distribution using gamma criteria of 2%/2 mm with a 50% minimum dose threshold for 6 MV was 98.8%, for 10 MV was 97.5%, respectively. The RMS values of MLC for 6 MV and 10 MV were 0.32 mm and 0.37 mm, of gantry were 0.33 degree and 0.31 degree. Conclusion: In this study, QA protocol to assess VMAT delivery accuracy is constructed and results acquired in this study are used as a baseline of VMAT delivery performance verification.

60 APPLIED LIFE SCIENCES↗

X-Ray Imaging and Spectroscopy Mission

The X-Ray Imaging and Spectroscopy Mission (XRISM) is a joint mission between the Japan Aerospace Exploration Agency (JAXA) and the National Aeronautics and Space Administration (NASA) in collaboration with the European Space Agency (ESA). In addition to the three space agencies, universities and research institutes from Japan, North America, and Europe have joined to contribute to developing satellite and onboard instruments, data-processing software, and the scientific observation program. XRISM is the successor to the ASTRO-H (Hitomi) mission, which ended prematurely in 2016. Its primary science goal is to examine astrophysical problems with precise, high-resolution X-ray spectroscopy. XRISM promises to discover new horizons in X-ray astronomy. It carries a 6 × 6 pixelized X-ray microcalorimeter on the focal plane of an X-ray mirror assembly (Resolve) and a co-aligned X-ray CCD camera (Xtend) that covers the same energy band over a large field of view. XRISM utilizes the Hitomi heritage, but all designs were reviewed. The attitude and orbit control system was improved in hardware and software. The spacecraft was launched from the JAXA Tanegashima Space Center on 2023 September 6 (UTC). During the in-orbit commissioning phase, the onboard components were activated. Although the gate valve protecting the Resolve sensor with a thin beryllium X-ray entrance window was not yet opened, scientific observation started in 2024 February with the planned performance verification observation program. The nominal observation program commenced with the following guest observation program beginning in 2024 September.

Astronomy and AstroPhysics↗

SU-E-T-173: Evaluation of the MicroSTAR Reader for the OSLD System for Remote Dosimetry Audits at the IROC HQAC

Purpose: Analysis of the performance of the microSTARii reader for optically stimulated luminescence dosimeters (OSLD) used by the IROC Houston Quality Assurance Center (IROC HQAC) for external audits compare to the characteristics of the Microstar reader. Methods: The IROC HQAC uses the Microstar reader for the OSLD program for verification of output of photon, electron and proton beams. The calculation of dose from the OSLD system is based on a group of factors defined at time of the commissioning of a batch of detectors. Factors like system sensitivity (SS), depletion (KD), element correction factor (ECF), linearity (KL), energy correction (KE). The new microSTARii unit presents many hardware and software upgrades that were considered useful for this program. Based on these changes many factors, that were considered reader dependent, were revised in order to analyze the effect of the new reading process. The SS, KD, ECF and KL were evaluated and compared with data defined based on reading done on Microstar reader. Results: The SS is reader specific and specified at 100 cGy dose level. This value is define per reading session and monitored over time. The KD factor was found to be different because of reading procedure are different. The ECF values changed for a group of nano dots compare to values defined based on reading done on the Microstar reader. The KL was defined for the reader. Conclusion: The new microSTARii reader presents new features that improve the efficiency of the OSLD program at the IROC HQAC. New characterization is needed before final implementation is done to match the requirements of the existing OSLD system defined for the Microstar reader. Changes in uncertainty of the results has not been analized.

07 ISOTOPE AND RADIATION SOURCES↗

Guidelines for preparing software user documentation

Clear, easy-to-use software user's manuals make strong demands on special technical communication techniques. Principles and guidelines are given for analyzing the audience and dealing with wide-ranging backgrounds of potential users. Types of information to be included in a complete manual are suggested, with a technique for creating a user-oriented rather than process-oriented organization. Accuracy verification is emphasized. Simple tips are gievn for formatting for quick comprehension and reference, for deciding on packaging, for creating helpful illustrations and examples, and for setting up clear and consistent conventions. Simple guidelines are offered for writing clearly and concisely and for editing.

Miller, Diane F.↗

NASA Scientific Data Purchase Project: From Collection to User

NASA's Scientific Data Purchase (SDP) project is currently a $70 million operation managed by the Earth Science Applications Directorate at Stennis Space Center. The SDP project was developed in 1997 to purchase scientific data from commercial sources for distribution to NASA Earth science researchers. Our current data holdings include 8TB of remote sensing imagery consisting of 18 products from 4 companies. Our anticipated data volume is 60 TB by 2004, and we will be receiving new data products from several additional companies. Our current system capacity is 24 TB, expandable to 89 TB. Operations include tasking of new data collections, archive ordering, shipment verification, data validation, distribution, metrics, finances, customer feedback, and technical support. The program has been included in the Stennis Space Center Commercial Remote Sensing ISO 9001 registration since its inception. Our operational system includes automatic quality control checks on data received (with MatLab analysis); internally developed, custom Web-based interfaces that tie into commercial-off-the-shelf software; and an integrated relational database that links and tracks all data through operations. We've distributed nearly 1500 datasets, and almost 18,000 data files have been downloaded from our public web site; on a 10-point scale, our customer satisfaction index is 8.32 at a 23% response level. More information about the SDP is available on our Web site.

Nicholson, Lamar↗

Bringing Together Users and Developers of Forest Biomass Maps

Forests store carbon and thus represent important sinks for atmospheric carbon dioxide. Reducing uncertainty in current estimates of the amount of carbon in standing forests will improve precision of estimates of anthropogenic contributions to carbon dioxide in the atmosphere due to deforestation. Although satellite remote sensing has long been an important tool for mapping land cover, until recently aboveground forest biomass estimates have relied mostly on systematic ground sampling of forests. In alignment with fiscal year 2010 congressional direction, NASA has initiated work toward a carbon monitoring system (CMS) that includes both maps of forest biomass and total carbon flux estimates. A goal of the project is to ensure that the products are useful to a wide community of scientists, managers, and policy makers, as well as to carbon cycle scientists. Understanding the needs and requirements of these data users is helpful not just to the NASA CMS program but also to the entire community working on carbon-related activities. To that end, this meeting brought together a small group of natural resource managers and policy makers who use information on forests in their work with NASA scientists who are working to create aboveground forest biomass maps. These maps, derived from combining remote sensing and ground plots, aim to be more accurate than current inventory approaches when applied at local and regional scales. Meeting participants agreed that users of biomass information will look to the CMS effort not only to provide basic data for carbon or biomass measurements but also to provide data to help serve a broad range of goals, such as forest watershed management for water quality, habitat management for biodiversity and ecosystem services, and potential use for developing payments for ecosystem service projects. Participants also reminded the CMS group that potential users include not only public sector agencies and nongovernmental organizations but also the private sector because much forest acreage in the United States is privately held and needs data for forest management. Additional key outcomes identified by meeting participants include the following: (1) Priority should be given to building into the biomass product ease of use and low costs (including costs of hardware, software, and analysis requirements), (2) CMS products should also be relevant to other biomass measures for forest watershed management, habitat protection for biodiversity, and assessment of markets for ecosystem services, (3) CMS leadership should engage with the Subsidiary Body for Scientific and Technological Advice of the United Nations Framework Convention on Climate Change as they establish measuring, reporting, and verification standards, and (4) CMS leadership should continue to keep sister agencies and other organizations informed as CMS develops, particularly via the agencies active in the U.S. Global Change Research Program Carbon Cycle Interagency Working Group (U.S. Geological Survey, U.S. Department of Agriculture, and National Oceanic and Atmospheric Administration) and nongovernmental organizations.

Forest↗

Spot: A Programming Language for Verified Flight Software

The C programming language is widely used for programming space flight software and other safety-critical real time systems. C, however, is far from ideal for this purpose: as is well known, it is both low-level and unsafe. This paper describes Spot, a language derived from C for programming space flight systems. Spot aims to maintain compatibility with existing C code while improving the language and supporting verification with the SPIN model checker. The major features of Spot include actor-based concurrency, distributed state with message passing and transactional updates, and annotations for testing and verification. Spot also supports domain-specific annotations for managing spacecraft state, e.g., communicating telemetry information to the ground. We describe the motivation and design rationale for Spot, give an overview of the design, provide examples of Spot's capabilities, and discuss the current status of the implementation.

validation↗

Modeling Entanglement-Based Quantum Key Distribution for the NASA Quantum Communications Analysis Suite

One of the most practical, and sought after, applications of quantum mechanics in the field of information science is the use of entanglement distribution to communicate quantum information effectively. Similar to the continued improvements of functional quantum computers over the past decade, advances in demonstrations of entanglement distribution over long distances may enable new applications in aeronautics and space communications. The existing NASA Quantum Communications Analysis Suite (NQCAS) software models such applications, but limited experimental data exists to verify the model’s theoretical results. There is, however, a large body of experimental data in the relevant literature for entanglement-based quantum key distribution (QKD). This paper details a Monte Carlo based QKD model that uses NQCAS input parameters to generate an estimated QKD link budget for verification of NQCAS. The model generates link budget statistics like key rates, error rates, and S values that can then be compared to the experimental values in the literature. Preliminary comparisons show many similarities between the simulated and experimental data, supporting the model’s validity. A verified NQCAS model will inform experimental work conducted in Glenn Research Center’s (GRC) NASA Quantum Metrology Laboratory (NQML), supporting the United States Quantum Initiative and potential NASA missions.

NASA Quantum Communications Analysis Suite↗

Development and verification testing of automation and robotics for assembly of space structures

A program was initiated within the past several years to develop operational procedures for automated assembly of truss structures suitable for large-aperture antennas. The assembly operations require the use of a robotic manipulator and are based on the principle of supervised autonomy to minimize crew resources. A hardware testbed was established to support development and evaluation testing. A brute-force automation approach was used to develop the baseline assembly hardware and software techniques. As the system matured and an operation was proven, upgrades were incorprated and assessed against the baseline test results. This paper summarizes the developmental phases of the program, the results of several assembly tests, the current status, and a series of proposed developments for additional hardware and software control capability. No problems that would preclude automated in-space assembly of truss structures have been encountered. The current system was developed at a breadboard level and continued development at an enhanced level is warranted.

Rhodes, Marvin D.↗

SU-E-T-68: A Quality Assurance System with a Web Camera for High Dose Rate Brachytherapy

Purpose: The purpose of this work was to develop a quality assurance (QA) system for high dose rate (HDR) brachytherapy to verify the absolute position of an 192Ir source in real time and to measure dwell time and position of the source simultaneously with a movie recorded by a web camera. Methods: A web camera was fixed 15 cm above a source position check ruler to monitor and record 30 samples of the source position per second over a range of 8.0 cm, from 1425 mm to 1505 mm. Each frame had a matrix size of 480×640 in the movie. The source position was automatically quantified from the movie using in-house software (built with LabVIEW) that applied a template-matching technique. The source edge detected by the software on each frame was corrected to reduce position errors induced by incident light from an oblique direction. The dwell time was calculated by differential processing to displacement of the source. The performance of this QA system was illustrated by recording simple plans and comparing the measured dwell positions and time with the planned parameters. Results: This QA system allowed verification of the absolute position of the source in real time. The mean difference between automatic and manual detection of the source edge was 0.04 ± 0.04 mm. Absolute position error can be determined within an accuracy of 1.0 mm at dwell points of 1430, 1440, 1450, 1460, 1470, 1480, 1490, and 1500 mm, in three step sizes and dwell time errors, with an accuracy of 0.1% in more than 10.0 sec of planned time. The mean step size error was 0.1 ± 0.1 mm for a step size of 10.0 mm. Conclusion: This QA system provides quick verifications of the dwell position and time, with high accuracy, for HDR brachytherapy. This work was supported by the Japan Society for the Promotion of Science Core-to-Core program (No. 23003)

60 APPLIED LIFE SCIENCES↗

Aeroelastic Modeling for Distributed Wind Turbines: March 11, 2021 - November 10, 2021

Aeroelastic modeling (AM) is the primary methodology for structural and performance assessment of any wind turbine whereby providing an understanding of the impact of design parameters on its loading and power response before witnessing it in the field. Despite these advantages, the use of AM in the Distributed Wind Technology (DWT) sector is limited, especially within the less established manufacturers. This project represents an in-depth assessment of the status of AM and its role within the Standards for the DWT industry. The study gathered input and feedback from a large number of national and international stakeholders, reviewed technical strengths and weaknesses of the current edition of the design standards, analyzed recent industry workshops' and meetings' minutes, collected publicly available AM templates, and provided an evaluation of the existing AM codes. The study achieved several goals including providing strategies for the load assessment categorization of turbines based on rotor swept area and archetype, and guidance for AM verification and validation (V&V), which includes discussions of measurement requirements and a sample test-plan useful for future V&V campaigns and design standard development. This document summarizes the different tasks conducted in the course of the project and highlights the steps required to improve the AM adoption based on a multifaceted approach that encompasses: 1) augmenting AM software capabilities, 2) publishing AM best-practices and design-basis, 3) creating new model templates, 4) providing guidance for V&V of codes and specific turbine models leveraging field testing best-practice, and 5) addressing weaknesses in the current standards. Many of the future objectives identified in this study could leverage NREL's upcoming testing campaigns of three modern distributed wind turbines. Recommendations within this study will advance the value and the ease-of-use of AM, thereby allowing the industry to better capitalize this underutilized tool resulting in a more efficient design process, an easier path to certification, and overall better and more distributed reliable wind turbine products.

17 WIND ENERGY↗

Hydrodynamic Test Requirements Process Improvements

Hydrodynamic testing at Los Alamos National Laboratory would benefit from a process improvement for the requirements process. Cameo was used as a digital solution for requirements management to allow Lead Engineers to track requirements more effectively. This was identified as a process improvement throughout this Capstone project. This report includes a project proposal, business case, literature review, methodology, project plan, data analysis, decision-making report, financial analysis report, discussion, and conclusion. Initially, this project focused on figuring out a solution for the hydrotest requirement process improvements. The scope narrowed to focus on the use of Cameo for requirement capture and management. During this Capstone, four tests had digital models produced for requirements management in Cameo. The initial model was the baseline, with core requirements used across the tests. Commonalities in tests were used and the core requirements allowed for process efficiencies. In the data analysis, it was seen that overall, the implementation of using Cameo for requirements resulted in a decreasing trend for both schedule and normalized cost. Tests have different complexity levels which is also a factor in how long the requirements process will take. Additional data is needed to continue analyzing process improvements. Through decisionmaking and financial analysis, the recommendation was to use Cameo for requirements process improvement. Multiple experts provided feedback for requirements that were then captured within models. Numerous tangible and intangible benefits were identified with this process improvement. For return on investment, the metric of success was schedule reduction, which was overall seen. Four tests were analyzed, so future analysis will be needed. There is also not a great financial risk because the main cost would be purchasing more licenses. Individuals must generate requirements whether using this software or not. Overall, training is needed to help improve the skillsets of Lead Engineers but is already being supported on a regular frequency. A desktop guide was started associated with explaining the process, however, it is a work in progress. The team plans on adding additional information in the digital models to help status when requirements are met using verification methods and artifacts. From working on this project an improved understanding of Cameo and requirements was the result. There are future opportunities to extend the usage for requirements management and progress will continue after this project.

99 GENERAL AND MISCELLANEOUS↗