Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “complexity metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Probabilistic Approach to Assessing CCRS Capture System Performance Margin

In the aerospace industry, there are standard design principles and/or rule-of-thumb targets that define healthy levels of margins required at each developmental milestone for traditional metrics, such as mass, thermal, and power margins. When the technical resource is “non-traditional” in the sense that guiding margin principles are non-existent, systems engineering judgment is required to internally generate performance targets and methodologies to assess the system against the derived targets. This paper presents a probabilistic approach for assessing complex time-critical operations in order to apply global sensitivity analyses to identify input parameters that should (or should not) serve as design drivers.

Performance Margins↗

Probabilistic Approach to Assessing Capture System Performance Margin in Mars Sample Return's Capture, Containment, and Return System

In the aerospace industry, there are standard design principles and/or rule-of-thumb targets that define healthy levels of margins required at each developmental milestone for traditional metrics, such as mass, thermal, and power margins. When the technical resource is “non-traditional,” in the sense that guiding margin principles are non-existent, systems engineering processes are required to internally generate performance targets and methodologies to assess the system against the derived targets. This paper presents a probabilistic approach for assessing complex time-critical operations which applies global sensitivity analyses to identify input parameters that should drive the design. This approach is used to design a critical payload required for the Mars Sample Return campaign aiming at bringing back rock and atmospheric samples from Mars.

Performance Margins↗

Integrated Surface Power Strategy for Mars

A National Aeronautics and Space Administration (NASA) study team evaluated surface power needs for a conceptual crewed 500-day Mars mission. This study had four goals: 1. Determine estimated surface power needed to support the reference mission; 2. Explore alternatives to minimize landed power system mass; 3. Explore alternatives to minimize Mars Lander power self-sufficiency burden; and 4. Explore alternatives to minimize power system handling and surface transportation mass. The study team concluded that Mars Ascent Vehicle (MAV) oxygen propellant production drives the overall surface power needed for the reference mission. Switching to multiple, small Kilopower fission systems can potentially save four to eight metric tons of landed mass, as compared to a single, large Fission Surface Power (FSP) concept. Breaking the power system up into modular packages creates new operational opportunities, with benefits ranging from reduced lander self-sufficiency for power, to extending the exploration distance from a single landing site. Although a large FSP trades well for operational complexity, a modular approach potentially allows Program Managers more flexibility to absorb late mission changes with less schedule or mass risk, better supports small precursor missions, and allows a program to slowly build up mission capability over time. A number of Kilopower disadvantages-and mitigation strategies-were also explored.

Rucker, Michelle↗

Satellite Precipitation Measurements: What Have We Learnt About Cloud-Precipitation Processes From Space?

Precipitation is one of the fundamental elements that define global and regional climatology. Precipitation systems consist of a broad spectrum of three-dimensional structures in which microphysical processes interact with macro-scale processes in the cloud system and the ambient environment that prescribe the evolution of the system. Since 1970s, satellite observations of precipitation have been a fundamental tool in quantifying this complex interaction. They have first quantified the frequency and intensity of global precipitation, including remote areas over open oceans and polar regions, thus providing today’s precipitation climatology. More recently, satellite observations of cloud and precipitation have been exploited for understanding the physical mechanisms governing precipitation systems. A subset of these studies also provided observation-based metrics to probe physical processes operating in cloud-precipitation systems and to apply them as diagnostic measures for evaluating the representation of the processes in numerical models for better projections of future climate. In this chapter, we first review the theoretical basis of precipitation remote sensing from space and describe how it is practically applied in satellite missions. In the first part of the chapter, an historical overview of the satellite missions is described, summarising the instruments and retrieval algorithms developed in the missions. In the second part, we introduce a set of studies discussing the fundamental mechanisms behind precipitation formation, highlighting what we have learnt to date on cloud-precipitation processes from satellite observations.

Precipitation↗

Solar radio continuum storms and a breathing magnetic field model

Radio noise continuum emissions observed in metric and decametric wave frequencies are, in general, associated with actively varying sunspot groups accompanied by the S-component of microwave radio emissions. These continuum emission sources, often called type I storm sources, are often associated with type III burst storm activity from metric to hectometric wave frequencies. This storm activity is, therefore, closely connected with the development of these continuum emission sources. It is shown that the S-component emission in microwave frequencies generally precedes, by several days, the emission of these noise continuum storms of lower frequencies. In order for these storms to develop, the growth of sunspot groups into complex types is very important in addition to the increase of the average magnetic field intensity and area of these groups. After giving a review on the theory of these noise continuum storm emissions, a model is briefly considered to explain the relation of the emissions to the storms.

Source record↗

Online Planning Algorithm

AVA v2 software selects goals for execution from a set of goals that oversubscribe shared resources. The term goal refers to a science or engineering request to execute a possibly complex command sequence, such as image targets or ground-station downlinks. Developed as an extension to the Virtual Machine Language (VML) execution system, the software enables onboard and remote goal triggering through the use of an embedded, dynamic goal set that can oversubscribe resources. From the set of conflicting goals, a subset must be chosen that maximizes a given quality metric, which in this case is strict priority selection. A goal can never be pre-empted by a lower priority goal, and high-level goals can be added, removed, or updated at any time, and the "best" goals will be selected for execution. The software addresses the issue of re-planning that must be performed in a short time frame by the embedded system where computational resources are constrained. In particular, the algorithm addresses problems with well-defined goal requests without temporal flexibility that oversubscribes available resources. By using a fast, incremental algorithm, goal selection can be postponed in a "just-in-time" fashion allowing requests to be changed or added at the last minute. Thereby enabling shorter response times and greater autonomy for the system under control.

Rabideau, Gregg R.↗

Crew Scheduling Performance

As NASA considers long-duration exploration missions (LDEMs), it is envisioned that crew will behave more autonomously as compared to low-Earth orbit missions. The necessary shift of Ops Planners’ complete management of scheduling and planning to provide flexibility for crew to manage their own schedule in real-time requires significant research and investigation in evaluation of concepts of operations, of software tools to support tasks, and of crew performance to complete scheduling tasks. Our research objective is to characterize the human performance envelope for the task of planning and scheduling (crew self-scheduling), develop countermeasures to mitigate adverse performance effects due to plan complexity, and inform performance standards and guidelines based on research results. In our efforts to understand and characterize scheduling performance of crew members, we have conducted subject matter expert interviews to obtain feedback on scheduling plan complexity drivers and plan goodness. Following the pilot study conducted last year, we designed a study and have begun remote human subject testing to evaluate non-expert human performance, workload, and situational awareness for the task of planning and scheduling. This study investigates the effects of the number and type of constraints on human performance, and the differences in scheduling metrics between scheduling and rescheduling tasks. Subject testing is currently in progress, and we aim to collect data from approximately thirty subjects. We will summarize the methods used and impacts of the number and type of scheduling constraints. We will also present lessons learned as well as relevant results of the study.

crew scheduling↗

Transforming Science Prioritization Processes Using Artificial Intelligence

Artificial Intelligence (AI) and Machine Learning (ML) have potential to augment significantly the current labor-intensive processes of science prioritization, specifically by the National Academies’ Decadal Survey on behalf of NASA and NSF. Here we summarize what we believe to be the first exploratory demonstration-of-concept results from an application of AI/ML to Survey science prioritization. Specifically, we applied Latent Dirichlet Allocation (LDA) and Natural Language Processing (NLP) to reveal trends in published astrophysics research that may indicate science priorities and which could be applied to strategic planning. For the purpose of the work that we summarize here, AI/ML is able to analyze – that is, to “understand,” in a manner of speaking – a vast amount of text to reveal complex relationships among research topics, including the growth or decline of science community activities in those topics over time. We trained ourselves and AI/ML algorithms by using ~400,000 abstracts in the period 1998 to 2010 to “forecast” the Academies’ Astro2010 recommendations and compare with the solicited white papers. Comparing our results with actual Astro2010 recommendations allowed us to identify candidate metrics that better predicted the actual results of the Survey. We found, for example, that Compound Annual Growth Rate (CAGR) of papers published in a topic area is a good proxy measure for importance of this topic area of research. With this training complete, we identified candidate astrophysics astrophysics science priorities for the 2021+ period using the research during 2007 - 2019 . We conclude that appropriate application of AI can potentially significantly reduce the current workload of the Decadal Survey processes and reveal otherwise unrecognized characteristics in the body of astronomical research. We emphasize throughout the exploratory nature of our work, encouraging colleagues to pursue promising results further. Our most critical governing assumption was that increased (or decreased) research activity can be used to identify scientific or technology topic areas worthy of increased (or decreased) future emphasis. We discuss advantages, limitations, and recognize the “black box” nature of our technique. We note ethics issues associated, for example, with using AI/ML to reveal “hidden” meanings and biases in published work. Furthermore, inevitable improvements in AI may soon enable widespread and welcome identification of and advocacy for science and technology priorities by disparate and diverse groups and organizations. Consequently, we continue to urge a near-term, in-depth evaluation of appropriate applications of AI, including implications and consequences, as well as support for multiple follow-on assessments, of which ours is only a beginning.

Artificial Intelligence↗

Performance Evaluation and Modeling Techniques for Parallel Processors

In practice, the performance evaluation of supercomputers is still substantially driven by singlepoint estimates of metrics (e.g., MFLOPS) obtained by running characteristic benchmarks or workloads. With the rapid increase in the use of time-shared multiprogramming in these systems, such measurements are clearly inadequate. This is because multiprogramming and system overhead, as well as other degradations in performance due to time varying characteristics of workloads, are not taken into account. In multiprogrammed environments, multiple jobs and users can dramatically increase the amount of system overhead and degrade the performance of the machine. Performance techniques, such as benchmarking, which characterize performance on a dedicated machine ignore this major component of true computer performance. Due to the complexity of analysis, there has been little work done in analyzing, modeling, and predicting the performance of applications in multiprogrammed environments. This is especially true for parallel processors, where the costs and benefits of multi-user workloads are exacerbated. While some may claim that the issue of multiprogramming is not a viable one in the supercomputer market, experience shows otherwise. Even in recent massively parallel machines, multiprogramming is a key component. It has even been claimed that a partial cause of the demise of the CM2 was the fact that it did not efficiently support time-sharing. In the same paper, Gordon Bell postulates that, multicomputers will evolve to multiprocessors in order to support efficient multiprogramming. Therefore, it is clear that parallel processors of the future will be required to offer the user a time-shared environment with reasonable response times for the applications. In this type of environment, the most important performance metric is the completion of response time of a given application. However, there are a few evaluation efforts addressing this issue.

Dimpsey, Robert Tod↗

Performance Characterization of Digital Optical Data Transfer Systems for Use in the Space Radiation Environment

Radiation effects in photonic and microelectronic components can impact the performance of high-speed digital optical data link in a variety of ways. This segment of the short course focuses on radiation effects in digital optical data links operating in the MHz to GHz regime. (Some of the information is applicable to frequencies above and below this regime) The three basic component level effects that should be considered are Total Ionizing Dose (TID), Displacement Damage Dose (DDD) and Single Event Effects (SEE). In some cases the system performance degradation can be quantified from component level tests, while in others a more holistic characterization approach must be taken. In Section 2.0 of this segment of the Short Course we will give a brief overview of the space radiation environment follow by a summary of the basic space radiation effects important for microelectronics and photonics listed above. The last part of this section will give an example of a typical mission radiation environment requirements. Section 3.0 gives an overview of intra-satellite digital optical data link systems. It contains a discussion of the digital optical data link and it's components. Also, we discuss some of the important system performance metrics that are impacted by radiation effects degradation of optical and optoelectronic component performance. Section 4.0 discusses radiation effects in optical and optoelectronic components. While each component effect will be discussed, the focus of this section is on degradation of passive optical components and SEE in photodiodes (other mechanisms are covered in segment II of this short course entitled "Photonic Devices with Complex and Multiple Failure Modes"). Section 5.0 will focus on optical data link system response to the space radiation environment. System level SEE ground testing will be discussed. Then we give a discussion of system level assessment of data link performance when operating in the space radiation environment.

Reed, Robert A.↗

Digital Image Correlation for Performance Monitoring

Evaluating the health of a mechanism requires more than just a binary evaluation of whether an operation was completed. It requires analyzing more comprehensive, full-field data. Health monitoring is a process of non-destructively identifying characteristics that indicate the fitness of an engineered component. In order to monitor unit health in a production setting, an automated test system must be created to capture the motion of mechanism parts in a real-time and non-intrusive manner. One way to accomplish this is by using high-speed video and Digital Image Correlation (DIC). In this approach, individual frames of the video are analyzed to track the motion of mechanism components. The derived performance metrics allow for state-of-health monitoring and improved fidelity of mechanism modeling. The results are in-situ state-of-health identification and performance prediction. This paper introduces basic concepts of this test method, and discusses two main themes: the use of laser marking to add fiducial patterns to mechanism components, and new software developed to track objects with complex shapes, even as they move behind obstructions. Finally, the implementation of these tests into an automated tester is discussed.

Palaviccini, Miguel↗

ATTRACTOR: Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability

Autonomous systems (AS) are crucial to realizing the vision of new, complex transportation modes, such as advanced air mobility (AAM) and urban air mobility (UAM). A chief barrier to induction of AS into aviation is insufficient understanding of AS reliability in time-critical and safety-critical environments—an obstacle to certification. ATTRACTOR is aimed at building a basis for certification of classes of autonomous cyber-physical-human systems (CPHS) via establishing metrics and models of trustworthiness and trust in multi-agent team interactions, analyzable trajectories, explainability of computational algorithms (explainable artificial intelligence, or XAI), and persistent modeling and simulation, in the context of missions planning and operation. By “building a basis for certification,” we mean acquiring an understanding of when a system is trustworthy and developing computable means to estimate trustworthiness and trust in order to eventually inform functional requirements that contribute to certification. The outcomes are applicable not just to aviation but to all domains that rely on autonomous systems.

Autonomy↗

Early Artemis Surface Navigation: Challenges, Approaches, and Opportunities

The early Artemis missions represent the return of humanity to the surface of the Moon and provide opportunities for meeting early science and exploration goals. Position, Navigation, and Timing (PNT) capabilities are a fundamental element and inform operational design, flight rules, and the ability to meet these. This paper provides an overview of the needs, potential implementations, challenges, and concepts of operations in the initial human surface missions, Artemis III and IV. These early excursions are a crucial learning opportunity to gain more experience in the actual operational environment for Artemis V and beyond where exploration objectives and complexity increases. As part of the study, the team defined a threshold performance navigation requirement (including position and orientation) to meet crew safe return and assessed a breadth of navigation approaches that could be deployed to augment the crew’s baseline navigation capability. Data was collected in terms of size, mass, power, operational constraints, environment constraints, interface, and performance to define the technical metrics. Given these, the trade team conducted polling among the various Artemis Campaign elements to capture preference, integration challenges, and operational impacts. These were used to develop weightings and inform a ranked order of solutions across each of the early missions. The results of the study recommended augmenting the initial orientation capability with additional navigation sensors to provide coarse position and heading information to the crew to enable a safe contingency walk-back when out of video range. The team identified opportunities for embedding this hardware in future scenarios to provide an integrated solution. With the deployment of the LunaNet’s Lunar Augmented Navigation System, the crew will be able to maintain accurate real-time navigation knowledge with minimal physical impacts. Discussion of future testing and continued analysis is included in this paper. These forward plans and long-term architecture systems will enable a powerful navigation approach for orbiting and surface users, enabling a high level of scientific return and crew safety.

Evan Anzalone↗

Early Artemis Surface Navigation: Challenges, Approaches, and Opportunities

The early Artemis missions represent the return of humanity to the surface of the Moon and provide opportunities for meeting early science and exploration goals. Position, Navigation, and Timing (PNT) capabilities are a fundamental element and inform operational design, flight rules, and the ability to meet these. This paper provides an overview of the needs, potential implementations, challenges, and concepts of operations in the initial human surface missions, Artemis III and IV. These early excursions are a crucial learning opportunity to gain more experience in the actual operational environment for Artemis V and beyond where exploration objectives and complexity increases. As part of the study, the team defined a threshold performance navigation requirement (including position and orientation) to meet crew safe return and assessed a breadth of navigation approaches that could be deployed to augment the crew’s baseline navigation capability. Data was collected in terms of size, mass, power, operational constraints, environment constraints, interface, and performance to define the technical metrics. Given these, the trade team conducted polling among the various Artemis Campaign elements to capture preference, integration challenges, and operational impacts. These were used to develop weightings and inform a ranked order of solutions across each of the early missions. The results of the study recommended augmenting the initial orientation capability with additional navigation sensors to provide coarse position and heading information to the crew to enable a safe contingency walk-back when out of video range. The team identified opportunities for embedding this hardware in future scenarios to provide an integrated solution. With the deployment of the LunaNet’s Lunar Augmented Navigation System, the crew will be able to maintain accurate real-time navigation knowledge with minimal physical impacts. Discussion of future testing and continued analysis is included in this paper. These forward plans and long-term architecture systems will enable a powerful navigation approach for orbiting and surface users, enabling a high level of scientific return and crew safety.

Evan Anzalone↗

Navigating the Deployment and Downlink Tradespace for Earth Imaging Constellations

Distributed Spacecraft Missions (DSMs) are gaining momentum in their application to Earth Observation (EO) missions owing to their unique ability to increase observation sampling in spatial, spectral, angular and temporal dimensions simultaneously. DSM design includes a much larger number of variables than its monolithic counterpart, therefore, Model-Based Systems Engineering (MBSE) has been often used for preliminary mission concept designs, to understand the trade-offs and interdependencies among the variables. MBSE models are complex because the various objectives a DSM is expected to achieve are almost always conflicting, non-linear and rarely analytical. NASA Goddard Space Flight Center (GSFC) is developing a pre-Phase A tool called Tradespace Analysis Tool for Constellations (TAT-C) to initiate constellation mission design. The tool will allow users to explore the tradespace between various performance, cost and risk metrics (as a function of their science mission) and select Pareto optimal architectures that meet their requirements. This paper will describe the different types of constellations that TAT-C’s Tradespace Search Iterator is capable of enumerating (homogeneous Walker, heterogeneous Walker, precessing type, ad-hoc) and their impact on key performance metrics such as revisit statistics, time to global access and coverage. We will also discuss the ability to simulate phased deployment of the given constellations, as a function of launch availabilities and/or vehicle capability, and show the impact on performance. All performance metrics are calculated by the Data Reduction and Metric Computation module within TAT-C, which issues specific requests and processes results from the Orbit and Coverage module. Our TSI is also capable of generating tradespaces for downlinking imaging data from the constellation, based on permutations of available ground station networks - known (default) or customized (by the user). We will show the impact of changing ground station options for any given constellation, on data latency and required communication bandwidth, which in turn determines the responsiveness of the space system.

Nag, Sreeja↗

Streamlining the Design Tradespace for Earth Imaging Constellations

Distributed Spacecraft Missions (DSMs) are gaining momentum in their application to Earth Observation (EO) missions owing to their unique ability to increase observation sampling in spatial, spectral, angular and temporal dimensions simultaneously. DSM design includes a much larger number of variables than its monolithic counterpart, therefore, Model-Based Systems Engineering (MBSE) has been often used for preliminary mission concept designs, to understand the trade-offs and interdependencies among the variables. MBSE models are complex because the various objectives a DSM is expected to achieve are almost always conflicting, non-linear and rarely analytical. NASA Goddard Space Flight Center is developing a pre-Phase A tool called "Trade-space Analysis Tool for Constellations" (TAT-C) to initiate constellation mission design. The tool will allow users to explore the tradespace between various performance, cost and risk metrics (as a function of their science mission) and select Pareto optimal architectures that meet their requirements. This paper focuses on the tradespace search and how it can be streamlined by combining physical rules, as well as well-designed orbit and coverage computations, thus yielding significant speed-ups. Two use cases are shown as representative examples of the utility of TAT-C generated trades, and results are preliminarily validated against AGI's Systems Tool Kit.

Science Data Processing↗

Uncertainty Models for the Hybrid Parametric Variation Method of Uncertainty Quantification; Analysis

There is some level of uncertainty in every finite element model (FEM), which flows to a level of uncertainty in predicted results. The purpose of uncertainty quantification (UQ) is to provide statistical bounds on prediction accuracy based on model uncertainty. This is distinct from model updating, which attempts to modify models to improve their accuracy. UQ does not improve the accuracy of models, but accepts that the models are inherently inaccurate and attempts to quantify the impact of that inaccuracy on predicted results. Previously, an alternate method for UQ, called the Hybrid Parametric Variation (HPV) method, was applied to Space Launch System (SLS) Hurty/Craig-Bampton (HCB) components to predict system-level statistics for launch vehicle attitude control transfer functions and core stage section loads due to buffet. The HPV method combines a parametric variation of the HCB fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method that randomly varies the HCB mass and stiffness matrices as Wishart random matrix distributions using random matrix theory (RMT). Alternatively, the most common method for modeling uncertainty in the structural dynamics community is a parametric approach, which varies physical parameters in the model. However, there are several disadvantages associated with the parametric method. Determining a reduced set of parameters that have a significant impact on the system response can be time consuming, and the selected parameter probability distributions are rarely reliably known. Therefore, in practice, the parameters are surrogates for the actual errors, and the link to parameter uncertainty is unknown. Another major drawback is that the uncertainty that can be represented is limited to the form of the nominal FEM. It is the experience of the authors that based on numerous aerospace programs, almost all FEM errors are in form rather than parameter values. This hypothesis is supported by the observation of the authors that it is almost never possible to ‘tune’ a FEM to match modal test results by only modifying model parameters. Model-form uncertainty cannot be directly represented by FEM input parameters nor included in a parametric approach. However, model-form uncertainty can be modeled using RMT, where a probability distribution is developed for the matrix ensemble of interest. The major advantage of the NPV method is that it covers errors in model form. The HPV method anchors uncertainty at the HCB component level to component modal test results by matching the HCB and test modes based on mode descriptions or other methods, and then applying differing levels of frequency variation. The specific variations depend on the confidence to which a component FEM has been validated through modal testing. The NPV method is layered on the frequency variation to match modal test self-orthogonality and cross-orthogonality (XO) results. Once the component uncertainty models are identified, they are assembled, and the uncertainty is propagated to the system level using a Monte Carlo (MC) analysis approach that generates statistics for system-level predictions This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The second example is an application to a component that is design specific to the SLS. Based on this work and other assessments, the HPV method provides another tool to the toolset used for complex system UQ analysis. From experience gathered to date using the HPV method, additional design specific applications must be investigated to provide further confidence in the validity of the HPV method of UQ analysis.

Uncertainty quantification↗

The integrated manual and automatic control of complex flight systems

Research dealt with the general area of optimal flight control synthesis for manned flight vehicles. The work was generic; no specific vehicle was the focus of study. However, the class of vehicles generally considered were those for which high authority, multivariable control systems might be considered, for the purpose of stabilization and the achievement of optimal handling characteristics. Within this scope, the topics of study included several optimal control synthesis techniques, control-theoretic modeling of the human operator in flight control tasks, and the development of possible handling qualities metrics and/or measures of merit. Basic contributions were made in all these topics, including human operator (pilot) models for multi-loop tasks, optimal output feedback flight control synthesis techniques; experimental validations of the methods developed, and fundamental modeling studies of the air-to-air tracking and flared landing tasks.

Schmidt, David K.↗