Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Trustworthiness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A Distributed Simulation-to-Flight Framework to Support Investigating Trust/Trustworthiness in Multi-Agent Systems

As autonomous systems continue to grow both in use and complexity, the necessity for robust and extensible simulation-to-flight methods is paramount for establishing an effective architecture for autonomous systems. A fundamental objective of the ATTRACTOR (Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability) project was to design and develop a distributed mixed-reality simulation environment to begin establishing a basis for certification of autonomous systems via research into trust and trustworthiness. In this paper, we present an autonomous systems architecture and development framework paired with a persistent distributed modeling and simulation environment for test and evaluation of autonomous systems. The Autonomous Entity Operations Network (AEON) framework enables autonomous system development with an easily extensible collection of libraries and plug-n-play nodes facilitated by the Data Distribution Service (DDS) communication protocol standard. The Baseline Environment for Autonomous Modeling (BEAM) simulation environment is a distributed mixed-reality Unity™-based environment built around the same DDS communication paradigm allowing for easy integration with AEON-based autonomous applications. They were designed under ATTRACTOR in order to measure and establish trustworthiness and trust in single- and multi-agent human-machine systems whether these machines are fixed-wing general aviation, rotary-wing Unmanned Aerial Vehicles (UAVs), ground rovers, or even spacecraft. Together AEON and BEAM enable sim-to-flight with minimal configuration changes. By using AEON and BEAM, source code that runs in simulation ports directly to hardware and has successfully flown in the lab and in the National Airspace System (NAS) at NASA LaRC many times over the lifetime of ATTRACTOR.

Benjamin N Kelley↗

ExEP Yield Modeling Tool and Validation Test Results

EXOSIMS is an open-source simulation tool for parametric modeling of the detection yield and characterization of exoplanets. EXOSIMS has been adopted by the Exoplanet Exploration Programs Standards De nition and Evaluation Team (ExSDET) as a common mechanism for comparison of exoplanet mission concept studies. To ensure trustworthiness of the tool, we developed a validation test plan that leverages the Python-language unit-test framework, utilizes integration tests for selected module interactions, and performs end-to-end cross- validation with other yield tools. This paper presents the test methods and results, with the physics-based tests such as photometry and integration time calculation treated in detail and the functional tests treated summarily. The test case utilized a 4m unobscured telescope with an idealized coronagraph and an exoplanet population from the IPAC radial velocity (RV) exoplanet catalog. The known RV planets were set at quadrature to allow deterministic validation of the calculation of physical parameters, such as working angle, photon counts and integration time. The observing keepout region was tested by generating plots and movies of the targets and the keepout zone over a year. Although the keepout integration test required the interpretation of a user, the test revealed problems in the L2 halo orbit and the parameterization of keepout applied to some solar system bodies, which the development team was able to address. The validation testing of EXOSIMS was performed iteratively with the developers of EXOSIMS and resulted in a more robust, stable, and trustworthy tool that the exoplanet community can use to simulate exoplanet direct-detection missions from probe class, to WFIRST, up to large mission concepts such as HabEx and LUVOIR.

Nunez, Paul↗

Autonomy Technologies for Systems of a Moon Base

The aim of the workshop is to “explore emerging autonomy technologies that could enable or enhance mission capabilities, reduce mission risk, and reduce mission cost.” Enhancing mission capabilities will depend on how capable and trustworthy the autonomy implemented is. As systems increase in complexity, and also with multiple interdependent/interacting systems, current autonomy capability and trustworthiness is very low. A paradigm and technology from NASA that addresses this shortcoming will be discussed, the NASA Platform for Autonomous Systems (NPAS). NPAS also happens to address reduction of mission risk and cost. NPAS will be discussed as a capability that is reaching readiness for space use, but also serves as a reference to develop technologies suitable for integrated autonomous operations of lunar systems; encompassing autonomous systems, situational awareness, and reasoning and acting.

Autonomous systems↗

Differential Equation Approximation Using Gradient-Boosted Quantile Regression

The operation of cyber-physical-human (CPH) systems is subject to various epistemic and aleatory uncertainties. Overall trustworthiness of CPH systems relies on the trustworthiness of its components and their interactions. It is important that computational models comprising the cyber component of CPH provide predictions accompanied by a measure of confidence in model outcomes. Uncertainty quantification (UQ) and propagation are especially important in safety critical CPH systems. Gradient-boosted trees is a modeling approach capable both of learning the dynamics of a system and performing UQ. In this paper, we devise a method for using gradient boosting to learn the dynamics of a second order differential equation and estimate uncertainty at the same time. We do this by creating a custom loss function that trains the model to approximate the second derivative of a noisy time series, and to penalize based on a parameter that corresponds to the desired quantile. The resulting gradient boosting model can simulate stochastic trajectories of the system given a single starting point, that is, it can estimate both the expected trajectory and its uncertainty. We show that the uncertainty estimation is well calibrated and that the model can learn the dynamics even in the presence of noise. We demonstrate the approach on a simple cartpole system.

Autonomous systems↗

Beyond Fair: Engagement, Data Usability, and Open Community Productivity through the NASA Open Science Data Repository

The FAIR principle (findable, accessible, interoperable, and reusable) governs the storage and sharing of NASA space biology and health data[1]. These guiding principles maximize reuse of data and the reproducibility of scientific findings. The NASA Open Science Data Repository (OSDR; an expansion of NASA GeneLab) was built on the FAIR principles and houses over 500 studies and close to 1000 datasets from decades of space life sciences experiments. OSDR embodies the FAIR principles through data governance that includes mediated, embargoed, and fully open access data. The FAIR data governance principles were recently proposed to be expanded to encompass a FAIREST framework for assessing research data repositories (FAIR + Engagement, Social connections, and Trust)[2]. FAIREST emphasizes the importance of data repositories engaging with the scientific community and gaining the trust of researchers regarding data quality. Trust also refers to the TRUST principles developed for assessment of digital repositories: Transparency, Responsibility, User Focus, Sustainability, Technology[3]. We present the “Open Science for Life in Space” Analysis Working Groups (AWGs) as evidence regarding the power of engagement, social connections, and trust which has enhanced OSDR’s capabilities and productivity. AWG members engage in two main activities. One, members provide feedback on OSDR scientific standards for data ingestion, curation, and reuse (study, subject and assay metadata; processing pipelines; dataset formats and uniformed structures for machine-readability). Two, AWG members collaborate to mine-reuse OSDR data to conduct scientific analysis. With nearly 800 active members, the AWGs have resulted in 32 publications re-using OSDR data and contributed many papers in two major special issues in Cell (2020) and Nature (2024). AWGs also serve as networking groups, facilitate social connections between researchers at all levels of experience, and also have a social online ‘Forum’ used to keep members informed on projects and opportunities. This community-centric, productive, and trustworthy data culture has resulted in a broader effect with international space agencies, academics, and the commercial space sector wanting to submit their data to OSDR. Ten studies of Inspiration 4 data were recently publicly released by OSDR, as were some JAXA human data. Coming up soon in OSDR are data submissions from the European Space Agency, Virgin Galactic PIs, and SpaceX Polaris Dawn. A major benefit of OSDR is the array of standardized and uniformly formatted data (which was developed through AWG member consensus), from which visualization tools, analysis tools, and machine learning models can be built or trained. This talk will cover the Multi-Study Visualization Tool, the Environmental Data Application, RadLab, and a UCSF-NSF funded knowledge graph biomedical health discovery tool ‘SPOKE’ currently being integrated with OSDR. OSDR also provides training programs in bioinformatics and machine learning to improve the scientific community’s awareness of data availability and to boost their ability to perform data analysis. The increasing engagement of the scientific community and the public with technologies powered by artificial intelligence (AI) heightens the need for data analysis to be transparent. The AI for Life in Space initiative leverages the data products provided in OSDR to train AI models, with an emphasis on explainable and trustworthy AI, which would not be possible without FAIR data and metadata. Overall, here we will demonstrate the importance for NASA life sciences data repositories to adhere to the FAIREST framework, by providing examples and success stories from different aspects of OSDR.

data↗

Sustainable Aviation Operations and the Role of Information Technology and Data Science: Background, Current Status and Future Directions

This paper reviews the achievements of the international community towards environmentally friendly aviation operations, also referred to as Sustainable Aviation Operations in the last 25 years and the aspirations and goals to limit the impact of aviation and climate in the future. The framework for achieving global progress is provided by the International Civil Aviation Organization. NASA and FAA supported research and development to advance ATM concepts, and implemented the technology, concepts, and procedures that were responsible for creating fuel efficient flights. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. Future developments in aviation operations require new concepts, procedure, modeling, and analysis techniques. There is an increasing interest in applying methods based on Machine Learning Techniques to problems in Air Traffic Management. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and the availability of a rich historical database provide opportunities to exploit the richness of data-driven methods. The promises and challenges in applying Machine Learning Techniques to Air Traffic Management are discussed in the paper along with the testing and trustworthiness required for adoption of the techniques in operations.

Sustainable Aviation, Data Science, Machine Learni↗

Sustainable Aviation Operations and the Role of Information Technology and Data Science: Background, Current Status and Future Directions

This paper reviews the achievements of the international community towards environmentally friendly aviation operations, also referred to as Sustainable Aviation Operations in the last 25 years and the aspirations and goals to limit the impact of aviation and climate in the future. The framework for achieving global progress is provided by the International Civil Aviation Organization. NASA and FAA supported research and development to advance ATM concepts, and implemented the technology, concepts, and procedures that were responsible for creating fuel efficient flights. Historically aviation operations have been analyzed using physics-based models and provide information for making operational decisions. Future developments in aviation operations require new concepts, procedure, modeling, and analysis techniques. There is an increasing interest in applying methods based on Machine Learning Techniques to problems in Air Traffic Management. Aviation operations involving many decision makers, multiple objectives, poor or unavailable physics-based models and the availability of a rich historical database provide opportunities to exploit the richness of data-driven methods. The promises and challenges in applying Machine Learning Techniques to Air Traffic Management are discussed in the paper along with the testing and trustworthiness required for adoption of the techniques in operations.

Sustainable Aviation, Data Science, Machine Learni↗

Motivational Correlations of Strategy Choices in the Prisoner's Dilemma Game

The purpose of the present study was to investigate the relationship between the motivational dimensions assessed by the Motivation Analysis Test and prisoner's dilemma game behavior as measured both by the number of competitive strategy choices and the two-stage stochastic variables labelled trustworthiness, forgiveness, repentance, and trust by Rapoport.

Williams, Carl D.↗

Numerical aerodynamic simulation facility preliminary study, volume 2 and appendices

Data to support results obtained in technology assessment studies are presented. Objectives, starting points, and future study tasks are outlined. Key design issues discussed in appendices include: data allocation, transposition network design, fault tolerance and trustworthiness, logic design, processing element of existing components, number of processors, the host system, alternate data base memory designs, number representation, fast div 521 instruction, architectures, and lockstep array versus synchronizable array machine comparison.

Source record↗

A potpourri of pristine moon rocks, including a VHK mare basalt and a unique, augite-rich Apollo 17 anorthosite

The anorthosite fragment, 76504,18, the first of the Apollo 17's pristine anorthosites, was found to have: (1) a higher ratio of high-Ca pyroxine to low-Ca pyroxene, (2) higher Na in its plagioclase, (3) higher contents of incompatible elements, and (4) a higher Eu/Al ratio in comparison to ferroan anorthosites. With a parent melt having a negative Eu anomaly, 76504,18 closely resembles a typical mare basalt. This anorthosite was among the latest to be formed by plagioclase flotation above a primordial magmasphere; typical mare basalt regions accumulated at about the same time or even earlier. Another fragment 14181c, a very high potassium basalt, was studied and found to be similar to typical Apollo 14 mare basalt though it has a K/La ratio of 1050. It is suggested that this lithology formed after a normal Apollo 14 mare basaltic melt partially assimilated granite. New data for siderphile elements in Apollo 12 mare basalts indicate that only the lowest of earlier data are trustworthy as being free of laboratory contamination.

Warren, P. H.↗

Evaluation of competing software reliability predictions

Different software reliability models can produce very different answers when called upon to predict future reliability in a reliability growth context. Users need to know which, if any, of the competing predictions are trustworthy. Some techniques are presented which form the basis of a partial solution to this problem. Rather than attempting to decide which model is generally best, the approach adopted here allows a user to decide upon the most appropriate model for each application.

Abdel-Ghaly, A. A.↗

What FM can offer DFCS design

The results of aircrafts and spacecrafts flight tests are reported. It is shown that the problems of Digital Flight Control Systems (DFCS) are the problems of systems whose complexity has exceeded the reach of the intellectual tools employed. It is also shown that intuition, experience, and techniques derived from mechanical and analog systems are insufficient for complex, integrated, digital systems. Formal Methods (FM) of computer science can offer DFCS systematic techniques for the construction of trustworthy software, including: techniques for the precise specification of requirements and the development of designs; systematic approaches to the design and structuring of distributed and concurrent systems; fault tolerance algorithms; and systematic methods of testing and analytic methods of verification.

Rushby, John↗

Saltation threshold detection in a wind tunnel by the measurement of the net electrostatic charge

The Mars surface wind tunnel (MARSWIT) is an open circuit wind tunnel used for aeolian studies and is located inside a large vacuum chamber allowing testing at Martian surface atmospheric pressure. Since direct access is not available to the tunnel during operation at low pressure, a remote method of saltation detection is needed. The bed is observed by means of closed circuit video, but it is often difficult to determine the initiation of threshold. The measurement by means of an electrometer of the net electric charge produced by the saltating particles has provided a reliable means of saltation threshold detection. Saltating particles become charged several ways, both in wind tunnels and in a natural environment. The most significant of these methods are tribo-charging and contact charging, which always occur. Fracture charging may also occur under the high velocities associated with particle transport on Mars or under simulated Martian conditions. Detection in MARSWIT is achieved by allowing the saltating particles to impinge on a planar conducting surface normal to the flow that is connected to ground through a Keithly electrometer. The signal from the electrometer is connected to a strip chart recorder along with the analog signal from the pitot tube transducer that is used to determine the wind velocity in the tunnel. Thus, a record of wind velocity and the initiation of particle saltation is conveniently displayed together. While both positive and negative charges are produced during saltation, this method measures only the net charge; thus the charge may be either positive or negative depending upon the particles being tested, the size and size distribution of the test material, and the wind velocity. This has proven to be a very trustworthy and sensitive method of saltation threshold detection, being especially useful with the smaller sized particles which are the most difficult to observe visually.

Leach, Rodman N.↗

Aerodynamic theory and test of strut forms. Part I

This report presents the first part of a two part study made under this title. In this part the symmetrical inviscid flow about an empirical strut of high service merit is found by both the Rankine and the Joukowsky methods. The results can be made to agree as closely as wished. Theoretical stream surfaces as well as surfaces of constant speed and pressure in the fluid about the strut are found. The surface pressure computed from the two theories agrees well with the measured pressure on the fore part of the model but not so well on the after part. From the theoretical flow speed the surface friction is computed by an empirical formula. The drag integrated from the friction and measured pressure closely equals the whole measured drag. As the pressure drag and the whole drag are accurately determined, the friction formula also appears trustworthy for such fair shapes. (author)

Smith, R H↗

Survey of lift-fan aerodynamic technology

Representatives of NASA Ames Research Center asked that a summary of technology appropriate for lift-fan powered short takeoff/vertical landing (STOVL) aircraft be prepared so that new programs could more easily benefit from past research efforts. This paper represents one of six prepared for that purpose. The authors have conducted or supervised the conduct of research on lift-fan powered STOVL designs and some of their important components for decades. This paper will first address aerodynamic modeling requirements for experimental programs to assure realistic, trustworthy results. It will next summarize the results or efforts to develop satisfactory specialized STOVL components such as inlets and flow deflectors. It will also discuss problems with operation near the ground, aerodynamics while under lift-fan power, and aerodynamic prediction techniques. Finally, results of studies to reduce lift-fan noise will be presented. The paper will emphasize results from large scale experiments, where available, for reasons that will be brought out in the discussion. Some work with lift-engine powered STOVL aircraft is also applicable to lift-fan technology and will be presented herein. Small-scale data will be used where necessary to fill gaps.

Hickey, David H.↗

Instruction set commutivity

We present a state property called congruence and show how it can be used to demonstrate commutivity of instructions in a modern load-store architecture. Our analysis is particularly important in pipelined microprocessors where instructions are frequently reordered to avoid costly delays in execution caused by hazards. Our work has significant implications to safety and security critical applications since reordering can easily change the meaning and an instruction sequence and current techniques are largely ad hoc. Our work is done in a mechanical theorem prover and results in a set of trustworthy rules for instruction reordering. The mechanization makes it practical to analyze the entire instruction set.

Windley, P.↗

Non-dipolar magnetic field models and patterns of radio emission: Uranus and Neptune compared

The magnetic field geometries of Uranus and Neptune are superficially similar, and are similarly unlike those of other planets: the field strengths are similar, and they contain extraordinarily large non-dipolar components. As a corollary, the best dipolar field models of each of the two planets comprises a dipole that is considerably offset from the planetary center and tilted away from the rotational axis. However, in other respects the best field models of the two planets are quite different. Uranus has a quadrupole model in which all the terms are well determined and in which none of the higher order terms is determined. To represent the magnetometer data acquired during Voyager's Neptune encounter requires a model of order 8 (instead of Uranus' order 2), yet many of the coefficients are poorly determined. A second model, an octupole model comprising the terms up to order three of the order 8 model, has been suggested by the magnetometer team as being useful; its use, however, is limited only to the region outside of about 2R(exp N), whereas planetary radio emissions have their sources well inside this surface. Computer code has been written that permits an analysis of the detailed motion of low energy charged particles moving in general planetary magnetic fields. At Uranus, this code reveals the existence of an isolated region of the inner magnetosphere above the day side in which particles may be trapped, separate from the more general magnetospheric trapping. An examination of the so-call ordinary mode uranian radio emissions leads us to believe that these emissions are in fact extraordinary mode emissions coming from particles trapped in this isolated region. A similar attempt to discover trapping regions at Neptune has proved, unfortunately, to be impossible. This arises from three factors: (1) the computation needed to track particles in an eighth order field is more than an order of magnitude greater than that needed to perform a similar calculation in a quadrupole field, and is beyond the capacity of workstation-class computers; (2) the octupole field model is known to be in error by too large an ammount for it, or any similarly truncated version of the eighth order model, to produce trustworthy results; (3) the eighth order model can, in effect, be infinitely varied without affecting the field strength along the spacecraft trajectory.

Evans, D. R.↗