Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “complexity metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Managing Complex Space Missions Like the James Webb Space Telescope

Program Management Summary; Organizational structure is established. Roles and responsibilities are well defined: a) All major contracts are in place. b) All foreign partners are in place, operating under signed Memoranda of Understanding (MOUs). c) Partners include GSFC, NGST, Ball, ITT, ATK, STScI, ESA, CSA, UAz, LM, JPL, MSFC, ARC, JSC, etc. All enabling technologies are at Technical Readiness Level-6. Earned Value Management is being applied to all major contracts consistent with Agency guidance. Schedules are baselined and the project critical path is understood/managed. Budget with reserves established. Liens and threats system in use. Formal Configuration Management (CM) processes are in place. Project-level schedules are maintained within the CM system. Formal Risk Management processes are in place. Requirements are stable and flowed down. Project metrics are established and tracked monthly: a) Includes technical as well as cost and schedule metrics. b) Changes as well as trends are reported each month.

Sabelhaus, Phil↗

Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC): A Proposed Mission to the Lunar South Pole-Aitken Basin

The global Lunar Magma Ocean (LMO) hypothesis is based on analyses of ferroan anorthosites (FAN), magnesian plutonic rocks (Mg-suite), and KREEPy (Potassium - K; Rare Earth Elements - REE; Phosphorous - P) material present at the Apollo landing sites and the assumed global distribution of these lithologies. However, orbital spacecraft data over the last two decades have highlighted that the location of the Apollo missions within and near the Procellarum KREEP Terrane (PKT) is compositionally anomalous and not representative of the entire lunar surface and suggests that Apollo samples provide a biased view of the Moon. Further, meteorites, which originate from random areas on the lunar surface, including those not visited by Apollo, Luna, or Chang’E-5, provide complementary datasets that reveal a more complex lunar formation and evolution than the simple LMO onion skin model. While many recent investigations support and refine the LMO model, other recent studies have questioned whether this mechanism alone is responsible for the primordial differentiation of the Moon. Thus, relating the distinct and asymmetrically distributed geochemical terranes on the Moon, especially KREEP which is a predicted global LMO product, to lunar formation and differentiation remains a fundamental goal of lunar science. The South Pole-Aitken (SPA) impact carved a two-and-a-half thousand-kilometer basin into the Moon’s ancient crust, excavating material from as deep as the upper mantle. Orbital remote sensing of the basin indicates compositions with elevated thorium (Th) contents and unique mineralogies that provide a window into early lunar structure and LMO processes. We propose to land a powerful characterization laboratory at Birkeland crater on the far side of the Moon–where Th-rich SPA ejecta have been re-exposed near the surface–in order to address outstanding questions about the evolution of the Moon.

K M Cannon↗

A Categorization of Dynamic Analyzers

Program analysis techniques and tools are essential to the development process because of the support they provide in detecting errors and deficiencies at different phases of development. The types of information rendered through analysis includes the following: statistical measurements of code, type checks, dataflow analysis, consistency checks, test data,verification of code, and debugging information. Analyzers can be broken into two major categories: dynamic and static. Static analyzers examine programs with respect to syntax errors and structural properties., This includes gathering statistical information on program content, such as the number of lines of executable code, source lines. and cyclomatic complexity. In addition, static analyzers provide the ability to check for the consistency of programs with respect to variables. Dynamic analyzers in contrast are dependent on input and the execution of a program providing the ability to find errors that cannot be detected through the use of static analysis alone. Dynamic analysis provides information on the behavior of a program rather than on the syntax. Both types of analysis detect errors in a program, but dynamic analyzers accomplish this through run-time behavior. This paper focuses on the following broad classification of dynamic analyzers: 1) Metrics; 2) Models; and 3) Monitors. Metrics are those analyzers that provide measurement. The next category, models, captures those analyzers that present the state of the program to the user at specified points in time. The last category, monitors, checks specified code based on some criteria. The paper discusses each classification and the techniques that are included under them. In addition, the role of each technique in the software life cycle is discussed. Familiarization with the tools that measure, model and monitor programs provides a framework for understanding the program's dynamic behavior from different, perspectives through analysis of the input/output data.

Lujan, Michelle R.↗

Comparison of Node-Centered and Cell-Centered Unstructured Finite-Volume Discretizations: Viscous Fluxes - Part 1

Discretization of the viscous terms in current finite-volume unstructured-grid schemes are compared using node-centered and cell-centered approaches in two dimensions. Accuracy and efficiency are studied for six nominally second-order accurate schemes: a node-centered scheme, cell-centered node-averaging schemes with and without clipping, and cell-centered schemes with unweighted, weighted, and approximately mapped least-square face gradient reconstruction. The grids considered range from structured (regular) grids to irregular grids composed of arbitrary mixtures of triangles and quadrilaterals, including random perturbations of the grid points to bring out the worst possible behavior of the solution. Two classes of tests are considered. The first class of tests involves smooth manufactured solutions on both isotropic and highly anisotropic grids with discontinuous metrics, typical of those encountered in grid adaptation. The second class concerns solutions and grids varying strongly anisotropically over a curved body, typical of those encountered in high-Reynolds number turbulent flow simulations. Results from the first class indicate the face least-square methods, the node-averaging method without clipping, and the node-centered method demonstrate second-order convergence of discretization errors with very similar accuracies per degree of freedom. The second class of tests are more discriminating. The node-centered scheme is always second order with an accuracy and complexity in linearization comparable to the best of the cell-centered schemes. In comparison, the cell-centered node-averaging schemes are less accurate, have a higher complexity in linearization, and can fail to converge to the exact solution when clipping of the node-averaged values is used. The cell-centered schemes using least-square face gradient reconstruction have more compact stencils with a complexity similar to the complexity of the node-centered scheme. For simulations on highly anisotropic curved grids, the least-square methods have to be amended either by introducing a local mapping of the surface anisotropy or modifying the scheme stencil to reflect the direction of strong coupling.

Diskin, Boris↗

Constraining Global Coronal Models with Multiple Independent Observables

Global coronal models seek to produce an accurate physical representation of the Sun's atmosphere that can be used, for example, to drive space-weather models. Assessing their accuracy is a complex task, and there are multiple observational pathways to provide constraints and tune model parameters. Here, we combine several such independent constraints, defining a model-agnostic framework for standardized comparison. We require models to predict the distribution of coronal holes at the photosphere, and neutral line topology at the model's outer boundary. We compare these predictions to extreme-ultraviolet (EUV) observations of coronal hole locations, white-light Carrington maps of the streamer belt, and the magnetic sector structure measured in situ by Parker Solar Probe and 1 au spacecraft. We study these metrics for potential field source surface (PFSS) models as a function of source surface height and magnetogram choice, as well as comparing to the more physical Wang–Sheeley–Arge (WSA) and the Magnetohydrodynamic Algorithm outside a Sphere (MAS) models. We find that simultaneous optimization of PFSS models to all three metrics is not currently possible, implying a trade-off between the quality of representation of coronal holes and streamer belt topology. WSA and MAS results show the additional physics that they include address this by flattening the streamer belt while maintaining coronal hole sizes, with MAS also improving coronal hole representation relative to WSA. We conclude that this framework is highly useful for inter- and intra-model comparisons. Integral to the framework is the standardization of observables required of each model, evaluating different model aspects.

S. T. Badman↗

Energetic protons from a disappearing solar filament

A solar energetic (E 50 MeV) particle (SEP) event observed at 1 AU began about 15000 UT on 1981 December 5. This event was associated with a fast coronal mass ejection observed with the Solwind coronagraph on the P78-1 satellite. No metric type 2 or type 4 burst was observed, but a weak interplanetary type 2 burst was observed with the low frequency radio experiment on the International Sun-Earth Explorer-3 satellite. The mass ejection was associated with the eruption of a large solar quiescent filament which lay well away from any active regions. The eruption resulted in an H alpha double ribbon structure which straddled the magnetic inversion line. No impulsive phase was obvious in either the H alpha or the microwave observations. This event indicates that neither a detectable impulsive phase nor a strong or complex magnetic field is necessary for the production of energetic ions.

Kahler, S. W.↗

Optimal Sensor Selection for Health Monitoring Systems

Sensor data are the basis for performance and health assessment of most complex systems. Careful selection and implementation of sensors is critical to enable high fidelity system health assessment. A model-based procedure that systematically selects an optimal sensor suite for overall health assessment of a designated host system is described. This procedure, termed the Systematic Sensor Selection Strategy (S4), was developed at NASA John H. Glenn Research Center in order to enhance design phase planning and preparations for in-space propulsion health management systems (HMS). Information and capabilities required to utilize the S4 approach in support of design phase development of robust health diagnostics are outlined. A merit metric that quantifies diagnostic performance and overall risk reduction potential of individual sensor suites is introduced. The conceptual foundation for this merit metric is presented and the algorithmic organization of the S4 optimization process is described. Representative results from S4 analyses of a boost stage rocket engine previously under development as part of NASA's Next Generation Launch Technology (NGLT) program are presented.

Santi, L. Michael↗

Increasing the Cost-efficiency of the DSN

JPL has operated the Deep Space Network (DSN) on behalf of NASA since the 1960's. Over the last two decades, the DSN budget has generally declined in real-year dollars while the aging assets required more attention, and the missions became more complex. As a result, the budget has been increasingly consumed by Operations and Maintenance (O and M), significantly reducing the funding wedge available for technology investment and for enhancing the DSN capability and capacity. Responding to this budget squeeze, the DSN launched an effort to improve the cost-efficiency of the O and M. In this paper we: Analyze the components of O&M. We note for example that, for the DSN, less than 20% of the staff engage in the traditional human-in-front-a-console role, so any effort to increase the cost efficiency must go beyond reducing the number of "Real-time operators." Explain the underlying organizational and cultural structures. Any cost-efficiency activities changes either accept, or carefully modify these structures. For example, the DSN O&M is based on the concept that there are three nearly identical antenna complexes separated by approximately 1200 in latitude and that each antenna complex is operated by a different contractor (driven by international agreements). Explore planned changes in the customer interface, e.g. web-based automated scheduling, and the processes required for a transition. Changes have to be evaluated in the larger end-to-end context, e.g. do the changes provide a net cost-efficiency for the DSN and the missions, or do they merely shift cost from the DSN to the missions. Consider possible significant changes in real-time pass management, e.g. full-remoting of operations, and lights-dim operations, while maintaining (or improving) the performance metrics of the DSN. Investigate how procedural and administrative changes could increase cost-efficiency, in conjunction with changes in the customer interfaces and real-time pass management. Examples would be handling of inter-governmental agreements, improved sharing of resources with other agencies, and better use of commercial (rather than government) resources

Deep Space Network (DSN)↗

Large Solar Energetic Particle Events Associated With Filament Eruptions Outside Active Regions

We report on four large filament eruptions (FEs) from solar cycles 23 and 24 that were associated with large solar energetic particle (SEP) events and interplanetary type II radio bursts. The post-eruption arcades corresponded mostly to C-class soft X-ray enhancements, but an M1.0 flare was associated with one event. However, the associated coronal mass ejections (CMEs) were fast (speeds approx. 1000 km/s) and appeared as halo CMEs in the coronagraph field of view. The interplanetary type II radio bursts occurred over a wide wavelength range, indicating the existence of strong shocks throughout the inner heliosphere. No metric type II bursts were present in three events, indicating that the shocks formed beyond 2-3 Rs. In one case, there was a metric type II burst with low starting frequency, indicating a shock formation height of approx.2 Rs. The FE-associated SEP events did have softer spectra (spectral index >4) in the 10-100 MeV range, but there were other low-intensity SEP events with spectral indices ⩾4. Some of these events are likely FE-SEP events, but were not classified as such in the literature because they occurred close to active regions. Some were definitely associated with large active region flares, but the shock formation height was large. We definitely find a diminished role for flares and complex type III burst durations in these large SEP events. Fast CMEs and shock formation at larger distances from the Sun seem to be the primary characteristics of the FE-associated SEP events.

filaments↗

Progressive Damage Analysis of Post-Buckled Stiffened Panels under Static Compressive Loading

The validation of progressive damage analysis methods requires experimental data that captures the initiation of damage, its evolution with continued loading, and the morphology of damage throughout its evolution. In support of the NASA Advanced Composites Project, several validation specimens of increasing complexity have been tested and characterized in order to provide the data required to assess the capabilities of several progressive damage analysis methods for fiber-reinforced composite materials. The analytical capabilities of interest for this validation program include networks of interacting matrix cracks and delaminations in post-buckled stiffened structures. A series of single stringer compression specimens was tested and characterized at NASA Langley Research Center. The experimental data from these tests are compared with progressive damage finite element analysis results. Test/analysis comparisons are made in terms of load/displacement histories, damage morphology, and damage size versus load metrics.

Frank A Leone↗

Capturing Multivariate Time Series Interactions to Detect High‑Risk Instability During Approach

The reduction of aviation safety metrics below target thresholds continue to drive down the number of aviation fatalities and accidents. To meet future safety demands, sustained efforts by aviation agencies promoting safety assurance processes and systems have prompted ongoing research on identifying and mitigating in-flight risks. With the projected increase in passenger load factor and rollout of more autonomous systems into the national airspace, the need to detect high-risk events in-time or ahead-of-time is becoming increasingly crucial. New anomaly detection and precursor identification algorithms will need to scale to different airframes, levels of autonomy, and system complexity. While the pervasiveness of deep learning has resulted in the development of performant anomaly detection methods, these sophisticated models currently suffer from low end-user interpretability. Building off our previous work on identifying adverse events in multivariate flight data during descent, we propose a data-driven approach for detecting in-flight adverse events caused by the complex interplay of flight variables. Our approach utilizes ordinal patterns of important aircraft stability variables (e.g., airspeed and descent rate) to capture multivariate flight dynamics that can be used to predict the onset of unstable approaches, a high-risk adverse event that can occur during approach. Through the use of ordinal patterns, we aim to create more interpretable detection models of in-flight adverse events that can be translated to future autonomous systems without difficulty. Our analysis shows the presence of distinct ordinal pattern distributions that can be used to predict unstable approaches 1 minute ahead of time with an accuracy of 0.69 and a recall of 0.73 and 30 seconds ahead with an accuracy of 0.70 and a recall of 0.86.

Risk detection↗

Comparison of earth-based radio metric data strategies for deep space navigation

Spacecraft angular coordinates can be determined with a variety of radio tracking measurements, such as Doppler, range, and Very Long Baseline Interferometry (VLBI)-derived data types. A relatively new interferometric tracking technique under development is Connected Element Interferometry (CEI), which uses a single frequency standard, distributed to two antennas spaced 10 to 100 km apart, to make highly accurate measurements of the phase-delay of incoming radio signals. The angular navigation accuracies attainable with Doppler, range, CEI, and VLBI data strategies are compared, using simple analytic models for these data types. The measurement accuracies assumed for Doppler, range, and VLBI data represent the performance expected from these systems in the Magellan and Galileo missions, while the assumed CEI data accuracy represents the anticipated performance of an experimental connected element system being constructed at the Deep Space Network's Goldstone, California complex. The results indicate that the Galileo VLBI system can deliver 20- to 25-nrad accuracy throughout the ecliptic plane. A hypothetical CEI dual-baseline sysem at Goldstone yielded accuracies in the 35- to 50-nrad range, while another hypothetical Goldstone-based system, consisting of a single CEI baseline and an X-band (8.4 GHz) Doppler system, produced accuracies of 25 to 100 nrad. Angular accuracies obtained from Doppler and range were found to be highly dependent upon the sensitivity of earth-spacecraft differential acceleration to small changes in geocentric spacecraft position.

Thurman, Sam W.↗

Measuring, Enabling and Comparing Modularity, Regularity and Hierarchy in Evolutionary Design

For computer-automated design systems to scale to complex designs they must be able to produce designs that exhibit the characteristics of modularity, regularity and hierarchy - characteristics that are found both in man-made and natural designs. Here we claim that these characteristics are enabled by implementing the attributes of combination, control-flow and abstraction in the representation. To support this claim we use an evolutionary algorithm to evolve solutions to different sizes of a table design problem using five different representations, each with different combinations of modularity, regularity and hierarchy enabled and show that the best performance happens when all three of these attributes are enabled. We also define metrics for modularity, regularity and hierarchy in design encodings and demonstrate that high fitness values are achieved with high values of modularity, regularity and hierarchy and that there is a positive correlation between increases in fitness and increases in modularity. regularity and hierarchy.

Hornby, Gregory S.↗

Tracking Climate Effects on Plant-Pollinator Interaction Phenology with Satellites and Honey Bee Hives

Background/Question/Methods: The complexity of plant-pollinator interactions, the large number of species involved, and the lack of species response functions present challenges to understanding how these critical interactions may be impacted by climate and land cover change on large scales. Given the importance of this interaction for terrestrial ecosystems, it is desirable to develop new approaches. We monitor the daily weight change of honey bee (Apis mellifera) colonies to record the phenology of the Honey Bee Nectar Flow (HBNF) in a volunteer network (honeybeenet.gsfc.nasa.gov). The records document the successful interaction of a generalist pollinator with a variety of plant resources. We extract useful HBNF phenology metrics for three seasons. Sites currently exist in 35 states/provinces in North America, with a concentration in the Mid-Atlantic region. HBNF metrics are compared to standard phenology metrics derived from remotely sensed vegetation indices from NASA's MODIS sensor and published results from NOAA's A VHRR. At any given time the percentage of plants producing nectar is usually a sma11 fraction of the total satellite sensor signal. We are interested in determining how well the 'bulk' satellite vegetation parameters relate to the phenology of the HBNF, and how it varies spatially on landscape to continental scales. Results/Conclusions: We found the median and peak seasonal HBNF dates to be robust, with variation between replicate scale hives of only a few days. We developed quality assessment protocols to identify abnormal colony artifacts. Temporally, the peak and median of the HBNF in the Mid-Atlantic show a significant advance of 0.58 d/y beginning about 1970, very similar to that observed by the A VHRR since 1982 (0.57 d/y). Spatially, the HBNF metrics are highly correlated with elevation and winter minimum temperature distribution, and exhibit significant but regionally coherent inter-annual variation. The relationship between median of the spring HBNF with the "Green-up" metric from the 500 meter MODIS NDVI phenology product, for sites throughout the Eastern US 2000-2009, is well described by a single linear fit (r(exp 2) = 0.72). We conclude.that for the tree-dominated areas of the Eastern US at least the spring HBNF can be tracked very well by MODIS phenology. Analysis of other regions and seasons is presently underway but with more limited data. Spatial patterns in the eastern US and management implications will be presented and discussed.

Esaias, Wayne E.↗

Method for Tracking and Communicating Aggregate Risk Through the Use of Model-Based Systems Engineering (MBSE) Tools

Large, complex projects can identify a significant number and variety of risks, throughout the project life cycle. These risks are analyzed, mitigated, closed or accepted as independent uncertainties. Once closed or accepted, it is easy for projects to lose awareness of their impact. In reality, each of these risks contributes some amount to the overall risk posture of the project. The ability to track and effectively communicate this aggregate risk has represented a challenge to project management. There have been previous attempts to create a schema to communicate the aggregate effect of risks, without notable success. Most of these attempts have centered on some additive metric derived from the scoring of likelihood and consequence values. This, in and of itself, is a logical approach, but all too often the scores were then aggregated to a level where all context was lost. One weakness has been a lack of attempt to create linkages or logical groups of the risks upon which useful aggregation could then occur. The overall move to model-based (systems) engineering (MBSE) has opened up a vast frontier of opportunities to better integrate all project data. MBSE provides an underlying layer that links data items to each other. Objectives link to requirements, which then link to functions, functions to physical architecture items, and so on, as far down as projects want to model. While it started with a focus on modeling requirements based on things like use cases, efforts are now underway to integrate safety and mission assurance (S&MA) information and analyses, such as risks. This effort, called Model Based Mission Assurance (MBMA), is yielding models that are more useful and are a more accurate representations of the systems. MBSE models, with this ability to link related items, provide a new means of tracking and communicating aggregate risks. In the proposed method, risks are added into the models as distinct items, having attributes that communicate a scoring derived from the likelihood and consequence values as charted on the standard NASA 5x5 risk matrix. Like earlier efforts, each box in the 5x5 has an associated scoring, which may include both a current score and potential post-mitigation/control score. The risk items are then linked to elements of the model, such as system objectives/goals, requirements, functions, or physical architecture items, with "Risk to" relationships. These risks will then be communicated by use of reports generated from the model, detailing all risks and/or hazards linked to model elements. These reports can include aggregate impacts, including a current scoring and potential future state scoring based on the planned mitigations and/or controls. These reports will show all risks, open, accepted, and closed, linked to project objectives or requirements. When run as part of an upcoming risk acceptance discussion, these reports will serve to remind the team of all previous risks that relate to the effected portion of the system. When included as part of periodic program or project reviews, risk reviews, and safety reviews, this method can improve the overall understanding of the system's true risk posture. This proposed method takes full advantage of the advances that modern modeling techniques provide, with a minimal investment of additional time. Utilizing the model environment also enables a near constant access to current state of aggregate risks.

model based mission assurance↗

Position Paper - pFLogger: The Parallel Fortran Logging framework for HPC Applications

In the context of high performance computing (HPC), software investments in support of text-based diagnostics, which monitor a running application, are typically limited compared to those for other types of IO. Examples of such diagnostics include reiteration of configuration parameters, progress indicators, simple metrics (e.g., mass conservation, convergence of solvers, etc.), and timers. To some degree, this difference in priority is justifiable as other forms of output are the primary products of a scientific model and, due to their large data volume, much more likely to be a significant performance concern. In contrast, text-based diagnostic content is generally not shared beyond the individual or group running an application and is most often used to troubleshoot when something goes wrong. We suggest that a more systematic approach enabled by a logging facility (or logger) similar to those routinely used by many communities would provide significant value to complex scientific applications. In the context of high-performance computing, an appropriate logger would provide specialized support for distributed and shared-memory parallelism and have low performance overhead. In this paper, we present our prototype implementation of pFlogger a parallel Fortran-based logging framework, and assess its suitability for use in a complex scientific application.

Fortran↗

POSITION PAPER - pFLogger: The Parallel Fortran Logging Framework for HPC Applications

In the context of high performance computing (HPC), software investments in support of text-based diagnostics, which monitor a running application, are typically limited compared to those for other types of IO. Examples of such diagnostics include reiteration of configuration parameters, progress indicators, simple metrics (e.g., mass conservation, convergence of solvers, etc.), and timers. To some degree, this difference in priority is justifiable as other forms of output are the primary products of a scientific model and, due to their large data volume, much more likely to be a significant performance concern. In contrast, text-based diagnostic content is generally not shared beyond the individual or group running an application and is most often used to troubleshoot when something goes wrong. We suggest that a more systematic approach enabled by a logging facility (or 'logger') similar to those routinely used by many communities would provide significant value to complex scientific applications. In the context of high-performance computing, an appropriate logger would provide specialized support for distributed and shared-memory parallelism and have low performance overhead. In this paper, we present our prototype implementation of pFlogger - a parallel Fortran-based logging framework, and assess its suitability for use in a complex scientific application.

Clune, Thomas L.↗

pFlogger: The Parallel Fortran Logging Utility

In the context of high performance computing (HPC), software investments in support of text-based diagnostics, which monitor a running application, are typically limited compared to those for other types of IO. Examples of such diagnostics include reiteration of configuration parameters, progress indicators, simple metrics (e.g., mass conservation, convergence of solvers, etc.), and timers. To some degree, this difference in priority is justifiable as other forms of output are the primary products of a scientific model and, due to their large data volume, much more likely to be a significant performance concern. In contrast, text-based diagnostic content is generally not shared beyond the individual or group running an application and is most often used to troubleshoot when something goes wrong. We suggest that a more systematic approach enabled by a logging facility (or 'logger)' similar to those routinely used by many communities would provide significant value to complex scientific applications. In the context of high-performance computing, an appropriate logger would provide specialized support for distributed and shared-memory parallelism and have low performance overhead. In this paper, we present our prototype implementation of pFlogger - a parallel Fortran-based logging framework, and assess its suitability for use in a complex scientific application.

Clune, Tom↗