Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Early Warning Look Ahead Metrics: The Percent Milestone Backlog Metric

All complex development projects experience delays and corresponding backlogs of their project control milestones during their acquisition lifecycles. NASA Goddard Space Flight Center (GSFC) Flight Projects Directorate (FPD) teamed with The Aerospace Corporation (Aerospace) to develop a collection of Early Warning Look Ahead metrics that would provide GSFC leadership with some independent indication of the programmatic health of GSFC flight projects. As part of the collection of Early Warning Look Ahead metrics, the Percent Milestone Backlog metric is particularly revealing, and has utility as a stand-alone execution performance monitoring tool. This paper describes the purpose, development methodology, and utility of the Percent Milestone Backlog metric. The other four Early Warning Look Ahead metrics are also briefly discussed. Finally, an example of the use of the Percent Milestone Backlog metric in providing actionable insight is described, along with examples of its potential use in other commodities.

acquisition lifecycles↗
DOE OSTI2025

Soil biogeochemical properties and metrics of tree-mycorrhizal dominance for a 25-Ha forest in South Central Indiana, USA.

This data package contains a dataset used in the papers “Seeing the forest for all the trees: Mycorrhizal-associated nutrient economies are modulated by stem density and the synchrony between overstory and understory communities” and “Mycorrhizal associations of tree species influence soil nitrogen dynamics via effects on soil acid–base chemistry”. Four csv files are included along with a dataset. The dataset features chemical soil properties for a single sampling campaign within the 25 Ha Lilly-Dickey Woods Smithsonian Forest Global Earth Observatory (ForestGEO) plot in South Central Indiana, USA (ldw_dat_raw.csv). Also included are separate files focused on pH (pH_data.csv), carbon and nitrogen (CN_data.csv), and nitrification rates (Nitrification_data.csv). These variables are commonly associated with the tree-mycorrhizal dominance of forest stands. In these data subsets, each soil variable was matched to a 10 meter radius neighborhood wherein metrics of tree-mycorrhizal dominance (basal area, stem count, importance value, etc.) were calculated. Models between these soil variables and dominance metrics were used to investigate how different assessments of mycorrhizal associated nutrient economies (MANE) capture these relationships. This research was performed as a part of the Smithsonian ForestGEO project. This data package can be used to explore spatial variability in soil chemistry within a mature hardwood forest, or it can be combined with the included tree data, other fine-scale spatial information, or other tree inventory data for the site to evaluate how soil chemistry varies with tree community composition or edaphic or topographic properties.

Craig, Matthew [ORNL] (ORCID:0000000288907920)↗
NASA NTRS1989

Experimental constraints on metric and non-metric theories of gravity

Experimental constraints on metric and non-metric theories of gravitation are reviewed. Tests of the Einstein Equivalence Principle indicate that only metric theories of gravity are likely to be viable. Solar system experiments constrain the parameters of the weak field, post-Newtonian limit to be close to the values predicted by general relativity. Future space experiments will provide further constraints on post-Newtonian gravity.

Will, Clifford M.↗
NASA NTRS1981

Software metrics: Software quality metrics for distributed systems

Software quality metrics was extended to cover distributed computer systems. Emphasis is placed on studying embedded computer systems and on viewing them within a system life cycle. The hierarchy of quality factors, criteria, and metrics was maintained. New software quality factors were added, including survivability, expandability, and evolvability.

Post, J. V.↗
NASA NTRS2011

Bootstrapping Process Improvement Metrics: CMMI Level 4 Process Improvement Metrics in a Level 3 World

The measurement techniques for organizations which have achieved the Software Engineering Institutes CMMI Maturity Levels 4 and 5 are well documented. On the other hand, how to effectively measure when an organization is Maturity Level 3 is less well understood, especially when there is no consistency in tool use and there is extensive tailoring of the organizational software processes. Most organizations fail in their attempts to generate, collect, and analyze standard process improvement metrics under these conditions. But at JPL, NASA's prime center for deep space robotic exploration, we have a long history of proving there is always a solution: It just may not be what you expected. In this paper we describe the wide variety of qualitative and quantitative techniques we have been implementing over the last few years, including the various approaches used to communicate the results to both software technical managers and senior managers.

Hihn, Jairus↗
NASA NTRS2023

Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC)

METRIC is a robotic science laboratory that can determine the mineralogy, elemental chemistry, micromorphology, and thermophysical properties of planetary regolith. The METRIC suite comprises METRIC XRD/F, an X-ray diffraction/X-ray fluorescence instrument that can determine the mineralogy and elemental chemistry of regolith samples; METRIC XCT, a micro X-ray computed tomography instrument that can be used to evaluate grain/crystallite sizes and textures; METRIC IRS, an imaging spectrometer mounted on a rover that can determine mineralogy and thermophysical properties at the landing site; and a pneumatic sample collection, processing, distribution system developed by Honeybee Robotics. The payload elements could be deployed on a static lander or a rover. Data returned from the METRIC payload would inform origin, formation, and evolution of rocky planetary bodies. METRIC XRD/F draws on heritage from the CheMin instrument on the Mars Science Laboratory (MSL) Curiosity rover [1], with a few important improvements. Like CheMin, METRIC XRD/F operates in transmission geometry and uses piezoelectric actuators on sample cells in a tuning fork geometry to induce convective grain motion of the regolith to create a randomly oriented powder. MSL CheMin uses an energy-sensitive CCD to collect XRD patterns and XRF spectra simultaneously from the same sample cell, resulting in qualitative XRF data. METRIC XRD/F uses two different sample cells, one optimized for XRD and one optimized for XRF, and a silicon drift detector to detect fluoresced X-rays. This improvement to the XRF capabilities provides quantitative geochemical data of major elements down to Z = 11 and allows for the detection of minor and trace elements that are critical for evaluating geologic evolution of the Moon (e.g., P and Th). Modest improvements to the XRD geometry and hardware allow for better angular resolution and the ability to distinguish between members of the pyroxene group. METRIC XCT uses the same geometry and much of the same hardware as METRIC XRD/F, where a CCD would capture images of a regolith sample in a 3 mm diameter sample tube that is rotated 360° in steps <1°. Image brightness can be used to infer compositional data, where brighter materials indicate a higher Z, much like scanning electron microscopy. Data from METRIC XCT complement those from METRIC XRD/F. Particle size, shape, and texture can provide petrologic and provenance information, whereas vesicle size and morphology in volcanic or impact melt lithologies can inform cooling rates. METRIC IRS is a hyperspectral thermal imager that can be mounted to a lander or rover to provide mineralogical data from the broader landing site and help determine whether the samples analyzed by METRIC XRD/F and XCT are representative. The METRIC IRS spectral range (8–14 μm) and resolution (10.8 cm-1) allow for quantitative mineralogy from modelling Reststrahlen bands of major rock-forming minerals (e.g., silicates, phosphates). Radiance cubes can be processed and modelled with an onboard high-performance computer to determine mineral abundances of plagioclase, high-Ca pyroxene, pigeonite, orthopyroxene, olivine, and glass. Regolith samples can be acquired, processed, and delivered to the X-ray instruments via multiple sample handling systems, but the pneumatic sampling systems developed by Honeybee Robotics [e.g., 2] are best suited for relatively low-cost missions that are being competed for the Moon (e.g., NASA’s Payloads and Research Investigations for the Surface of the Moon program). There are pneumatic sampling systems that collect surface material and other systems that pneumatically drill up to ~1 m below the surface, providing material that has not been space weathered and has not been affected by the lander’s exhaust. [1] Blake, D. F., Vaniman, D., Achilles, C., Anderson, R., Bish, D., et al. (2012). Space Sci. Rev. 170, 341-478. https://doi.org/10.1007/s11214-012-9905-1. [2] Zacny, K., Betts, B., Hedlund, M., Long, P., Gramlich, M., Tura, K., Chu, P., Jacob, A., Garcia, A. (2014). IEEE Aerospace Conference, 3-7 March 2014, Big Sky, MT, U.S.A.

X-ray diffraction↗
NASA NTRS1992

NASA metric transition plan

NASA science publications have used the metric system of measurement since 1970. Although NASA has maintained a metric use policy since 1979, practical constraints have restricted actual use of metric units. In 1988, an amendment to the Metric Conversion Act of 1975 required the Federal Government to adopt the metric system except where impractical. In response to Public Law 100-418 and Executive Order 12770, NASA revised its metric use policy and developed this Metric Transition Plan. NASA's goal is to use the metric system for program development and functional support activities to the greatest practical extent by the end of 1995. The introduction of the metric system into new flight programs will determine the pace of the metric transition. Transition of institutional capabilities and support functions will be phased to enable use of the metric system in flight program development and operations. Externally oriented elements of this plan will introduce and actively support use of the metric system in education, public information, and small business programs. The plan also establishes a procedure for evaluating and approving waivers and exceptions to the required use of the metric system for new programs. Coordination with other Federal agencies and departments (through the Interagency Council on Metric Policy) and industry (directly and through professional societies and interest groups) will identify sources of external support and minimize duplication of effort.

Source record↗
NASA NTRS1991

Candidate control design metrics for an agile fighter

Success in the fighter combat environment of the future will certainly demand increasing capability from aircraft technology. These advanced capabilities in the form of superagility and supermaneuverability will require special design techniques which translate advanced air combat maneuvering requirements into design criteria. Control design metrics can provide some of these techniques for the control designer. Thus study presents an overview of control design metrics and investigates metrics for advanced fighter agility. The objectives of various metric users, such as airframe designers and pilots, are differentiated from the objectives of the control designer. Using an advanced fighter model, metric values are documented over a portion of the flight envelope through piloted simulation. These metric values provide a baseline against which future control system improvements can be compared and against which a control design methodology can be developed. Agility is measured for axial, pitch, and roll axes. Axial metrics highlight acceleration and deceleration capabilities under different flight loads and include specific excess power measurements to characterize energy meneuverability. Pitch metrics cover both body-axis and wind-axis pitch rates and accelerations. Included in pitch metrics are nose pointing metrics which highlight displacement capability between the nose and the velocity vector. Roll metrics (or torsion metrics) focus on rotational capability about the wind axis.

Murphy, Patrick C.↗
NASA NTRSDate not supplied

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗
NASA NTRS1973

Metrication study for large space telescope

Various approaches which could be taken in developing a metric-system design for the Large Space Telescope, considering potential penalties on development cost and time, commonality with other satellite programs, and contribution to national goals for conversion to the metric system of units were investigated. Information on the problems, potential approaches, and impacts of metrication was collected from published reports on previous aerospace-industry metrication-impact studies and through numerous telephone interviews. The recommended approach to LST metrication formulated in this study cells for new components and subsystems to be designed in metric-module dimensions, but U.S. customary practice is allowed where U.S. metric standards and metric components are not available or would be unsuitable. Electrical/electronic-system design, which is presently largely metric, is considered exempt from futher metrication. An important guideline is that metric design and fabrication should in no way compromise the effectiveness of the LST equipment.

Creswick, F. A.↗
NASA NTRSDate not supplied

An Impedance-Based Complexity Metric for Unmanned Aircraft System Traffic Scenario Classification

This paper introduces an impedance-based metric to capture the complexity of a given unmanned aircraft system traffic scenario. The metric accounts for both the number of aircraft and the traffic flow pattern. The work presented here extends an earlier approach that introduced another scenario complexity metric based on the number of potential conflicts weighted by the conflict resolution cost associated. Complexity measurements for randomly-generated scenarios were produced through high-fidelity fast-time simulations and treated as baseline. Then the impedance based metric was evaluated, for the same scenarios, without the need for an actual flight simulation and a conflict resolution method. The results show that the impedance-based metric has a strong correlation to the baseline data and performs marginally better than the weighted conflict-based complexity metric introduced in the earlier work. The metric computation generates impedance maps which are useful for identifying high complexity regions in a scenario, where flight plan changes might be necessitated. This metric can therefore be used, in conjunction with other complexity metrics, to inform adequate traffic management strategies and classify a traffic scenario as acceptable, unacceptable or acceptable with changes made to flight plans that pass through the high complexity regions. The metric can also be used as a guidance metric for strategic conflict management methods.

Complexity↗
NASA NTRS1995

Goal-Driven Definition of Product Metrics Based on Properties

Defining product metrics requires a rigorous and disciplined approach, because useful metrics depend, to a very large extent, on one's goals and assumptions about the studied software process. Unlike in more mature scientific fields, it appears difficult to devise a "universal" set of metrics in software engineering, that can be used across application environments. We propose an approach for the definition of product metrics which is driven by the experimental goals of measurement, expressed via the Goal/Question/Metric (GQM) paradigm, and is based on the mathematical properties of the metrics. This approach integrates several research contributions from the literature into a consistent, practical and rigorous approach. The approach we outline should not be considered as a complete and definitive solution, but as a starting point for discussion about a product metric definition approach widely accepted in the software engineering community. At this point, we intend to provide an intellectual process that we think is necessary to define sound software product metrics. A precise and complete documentation of such an approach will provide the information needed to make the assessment and reuse of a new metric possible. Thus, product metrics are supported by a solid theory which facilitates their review and refinement. Moreover, their definition is made less exploratory and, as a consequence, one is less likely to identify spurious correlations between process and product metrics.

Briand, Lionel↗
NASA NTRS2007

A Contrast in Use of Metrics in Earth Science Data Systems

In recent years there has been a surge in the number of systems for processing, archiving and distributing remotely sensed data. Such systems, working independently as well as in collaboration, have been contributing greatly to the advances in the scientific understanding of the Earth system, as well as utilization of the data for nationally and internationally important applications. Among such systems, we consider those that are developed by or under the sponsorship of NASA to fulfill one of its strategic objectives: "Study Earth from space to advance scientific understanding and meet societal needs." NASA's Earth science data systems are of varying size and complexity depending on the requirements they are intended to meet. Some data systems are regarded as NASA's "Core Capabilities" that provide the basic infrastructure for processing, archiving and distributing a set of data products to a large and diverse user community in a robust and reliable manner. Other data systems constitute "Community Capabilities". These provide specialized and innovative services to data users and/or research products offering new scientific insight. Such data systems are generally supported by NASA through peer reviewed competition. Examples of Core Capabilities are 1. Earth Observing Data and Information System (EOSDIS) with its Distributed Active Archive Centers (DAACs), Science Investigator-led Processing Systems (SIPSs), and the EOS Clearing House (ECHO); 2. Tropical Rainfall Measurement Mission (TRMM) Science Data and Information System (TSDIS); 3. Ocean Data Processing System (ODPS); and 4. CloudSat Data Processing Center. Examples of Community Capabilities are projects under the Research, Education and Applications Solutions Network (REASON), and Advancing Collaborative Connections for Earth System Science (ACCESS) Programs. In managing these data system capabilities, it is necessary to have well-established goals and to measure progress relative to them. Progress is measured through "metrics", which can be a combination of quantitative as well as qualitative assessments. The specific metrics of interest depend on the user of the metrics as well as the type of data system. The users of metrics can be data system managers, program managers, funding agency or the public. Data system managers need metrics for assessing and improving the performance of the system and for future planning. Program managers need metrics to assess progress and the value of the data systems sponsored by them. Also, there is a difference in the metrics needed for core capabilities that tend to be more complex, larger and longer-term compared to community capabilities and the community capabilities that tend to be simpler, smaller and shorter-term. Even among community capabilities there are differences; hence the same set of metrics does not apply to all. Some provide data products to users, some provide services that enable better utilization of data or interoperability among other systems, and some are a part of a larger project where provision of data or services is only a minor activity. There is also a contrast between metrics used for internal and external purposes. Examples of internal purposes are: ensuring that the system meets its requirements, and planning for evolution and growth. Examples of external purposes are: providing to sponsors indicators of success of the systems, demonstrating the contributions of the system to overall program success, etc. This paper will consider EOSDIS, REASON and ACCESS programs to show the various types of metrics needed and how they need to be tailored to the types of data systems while maintaining the overall management goals of measuring progress and contributions made by the data systems.

Ramapriyan, Hampapuram↗
NASA NTRS2010

Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness

In black-box testing, the tester creates a set of tests to exercise a system under test without regard to the internal structure of the system. Generally, no objective metric is used to measure the adequacy of black-box tests. In recent work, we have proposed three requirements coverage metrics, allowing testers to objectively measure the adequacy of a black-box test suite with respect to a set of requirements formalized as Linear Temporal Logic (LTL) properties. In this report, we evaluate the effectiveness of these coverage metrics with respect to fault finding. Specifically, we conduct an empirical study to investigate two questions: (1) do test suites satisfying a requirements coverage metric provide better fault finding than randomly generated test suites of approximately the same size?, and (2) do test suites satisfying a more rigorous requirements coverage metric provide better fault finding than test suites satisfying a less rigorous requirements coverage metric? Our results indicate (1) only one coverage metric proposed -- Unique First Cause (UFC) coverage -- is sufficiently rigorous to ensure test suites satisfying the metric outperform randomly generated test suites of similar size and (2) that test suites satisfying more rigorous coverage metrics provide better fault finding than test suites satisfying less rigorous coverage metrics.

Staats, Matt↗
NASA NTRSDate not supplied

Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC): A Payload Designed for Exploration of Terrestrial Planetary Bodies

Geological materials (indeed, all solid objects) are characterized by their crystal structure, elemental composition, and morphology. The Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC) instrument suite quantifies all three. These measurements address fundamental science questions (e.g., the origin and evolution of planetary bodies) and support the human exploration of space (e.g., the characterization of regolith for ISRU and the constraint of its geotechnical properties). METRIC comprises an X-ray Diffraction/X-ray Fluorescence instrument (XRD: mineral structure and XRF: elemental composition), an X-ray micro-Computed Tomography instrument (XCT: 3D internal micromorphology), and a hyperspectral imaging infrared spectrometer (IRS) to provide local/regional mineralogic context for these measurements. METRIC XRD/F draws heritage from the highly successful Mars Science Laboratory CheMin instrument. The METRIC XRD/F employs two separate sample cells, one optimized for XRD and one for XRF, resulting in more rapid XRD analysis (tens of minutes vs. tens of hours for CheMin) and an orders-of-magnitude improvement in XRF detection. XCT has not been deployed in space, so the METRIC XCT represents a new capability for solar system exploration. The XCT uses the same basic high-TRL components as METRIC XRD/F, decreasing its development cost for flight. The METRIC IRS is a derivative of the NASA Earth Science Technology Office funded Hyperspectral Thermal Imager instrument and utilizes the NASA Technology Transfer Program to incorporate a commercial-of-the-shelf infrared camera ruggedized for space by NASA Marshall Space Flight Center. The IRS spectral range (8–14 µm) and resolution (10.8 cm -1 ) are tailored to quantify mineralogy in rocks using their characteristic Reststrahlen bands and to characterize mineralogy of soils using the position of the Christensen Feature. The METRIC payload is currently designed for deployment to the Moon on a Commercial Lunar Payload Services (CLPS) mission, where the XRD/F and XCT would be located on a lander and the IRS would be on deployed on a companion rover to evaluate the mineralogical diversity of the landing site. A pneumatic drill designed by Honeybee Robotics would excavate regolith up to 50 cm below the lander and deliver multiple aliquots of regolith to the XRD/F and XCT. The METRIC payload could also be deployed on a rover. In this case, a sample handling system on a robotic arm could scoop regolith and/or drill rocks and deliver powder to the XRD/F and XCT located in the rover’s interior. Alternatively, METRIC instruments could be used singly or in combination on human space missions. The XRD/F and XCT could be used to characterize samples in a rover or in a science laboratory within a habitat. These data could help astronauts identify resource-enriched rocks and regolith and triage geologic samples to return samples of high interest for analysis in terrestrial laboratories. The IRS could be attached to a human-navigated rover to collect mineralogical data along a traverse and identify high-priority science samples.

E. B. Rampe↗
NASA NTRSDate not supplied

Review of Noise Metric Sensitivities for Analysis of Quiet Supersonic Overflight

Six different noise metrics (PL, ASEL, BSEL, DSEL, ESEL, and ISBAP) are currently used to quantify sonic boom levels from overflight of supersonic aircraft. A previous meta-analysis using laboratory subjective data identified these metrics, each of which correlated well with human perception of low-boom sounds both indoors and outdoors. Because the analysis did not identify a single metric that was significantly superior, no internationally agreed-upon metric has been chosen for the quiet supersonic aircraft noise certification procedures currently under development. Other analyses of metric sensitivities using existing empirical and simulation datasets, however, have shown significant differences between metrics. Variability of metrics due to macro-atmospheric effects and atmospheric turbulence perturbations have been explored, as well as variability in measurements due to microphone setup configurations, array layouts, and ambient noise effects. This paper reviews these prior studies, summarizes the current understanding of metric sensitivities, and discusses how they may impact future downselection of metrics for certification procedures.

sonic boom↗
NASA NTRS2003

Semantic Metrics for Object Oriented Design

The purpose of this proposal is to research a new suite of object-oriented (OO) software metrics, called semantic metrics, that have the potential to help software engineers identify fragile, low quality code sections much earlier in the development cycle than is possible with traditional OO metrics. With earlier and better Fault detection, software maintenance will be less time consuming and expensive, and software reusability will be improved. Because it is less costly to correct faults found earlier than to correct faults found later in the software lifecycle, the overall cost of software development will be reduced. Semantic metrics can be derived from the knowledge base of a program understanding system. A program understanding system is designed to understand a software module. Once understanding is complete, the knowledge-base contains digested information about the software module. Various semantic metrics can be collected on the knowledge base. This new kind of metric measures domain complexity, or the relationship of the software to its application domain, rather than implementation complexity, which is what traditional software metrics measure. A semantic metric will thus map much more closely to qualities humans are interested in, such as cohesion and maintainability, than is possible using traditional metrics, that are calculated using only syntactic aspects of software.

Etzkorn, Lethe↗