Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC)

METRIC is a robotic science laboratory that can determine the mineralogy, elemental chemistry, micromorphology, and thermophysical properties of planetary regolith. The METRIC suite comprises METRIC XRD/F, an X-ray diffraction/X-ray fluorescence instrument that can determine the mineralogy and elemental chemistry of regolith samples; METRIC XCT, a micro X-ray computed tomography instrument that can be used to evaluate grain/crystallite sizes and textures; METRIC IRS, an imaging spectrometer mounted on a rover that can determine mineralogy and thermophysical properties at the landing site; and a pneumatic sample collection, processing, distribution system developed by Honeybee Robotics. The payload elements could be deployed on a static lander or a rover. Data returned from the METRIC payload would inform origin, formation, and evolution of rocky planetary bodies. METRIC XRD/F draws on heritage from the CheMin instrument on the Mars Science Laboratory (MSL) Curiosity rover [1], with a few important improvements. Like CheMin, METRIC XRD/F operates in transmission geometry and uses piezoelectric actuators on sample cells in a tuning fork geometry to induce convective grain motion of the regolith to create a randomly oriented powder. MSL CheMin uses an energy-sensitive CCD to collect XRD patterns and XRF spectra simultaneously from the same sample cell, resulting in qualitative XRF data. METRIC XRD/F uses two different sample cells, one optimized for XRD and one optimized for XRF, and a silicon drift detector to detect fluoresced X-rays. This improvement to the XRF capabilities provides quantitative geochemical data of major elements down to Z = 11 and allows for the detection of minor and trace elements that are critical for evaluating geologic evolution of the Moon (e.g., P and Th). Modest improvements to the XRD geometry and hardware allow for better angular resolution and the ability to distinguish between members of the pyroxene group. METRIC XCT uses the same geometry and much of the same hardware as METRIC XRD/F, where a CCD would capture images of a regolith sample in a 3 mm diameter sample tube that is rotated 360° in steps <1°. Image brightness can be used to infer compositional data, where brighter materials indicate a higher Z, much like scanning electron microscopy. Data from METRIC XCT complement those from METRIC XRD/F. Particle size, shape, and texture can provide petrologic and provenance information, whereas vesicle size and morphology in volcanic or impact melt lithologies can inform cooling rates. METRIC IRS is a hyperspectral thermal imager that can be mounted to a lander or rover to provide mineralogical data from the broader landing site and help determine whether the samples analyzed by METRIC XRD/F and XCT are representative. The METRIC IRS spectral range (8–14 μm) and resolution (10.8 cm-1) allow for quantitative mineralogy from modelling Reststrahlen bands of major rock-forming minerals (e.g., silicates, phosphates). Radiance cubes can be processed and modelled with an onboard high-performance computer to determine mineral abundances of plagioclase, high-Ca pyroxene, pigeonite, orthopyroxene, olivine, and glass. Regolith samples can be acquired, processed, and delivered to the X-ray instruments via multiple sample handling systems, but the pneumatic sampling systems developed by Honeybee Robotics [e.g., 2] are best suited for relatively low-cost missions that are being competed for the Moon (e.g., NASA’s Payloads and Research Investigations for the Surface of the Moon program). There are pneumatic sampling systems that collect surface material and other systems that pneumatically drill up to ~1 m below the surface, providing material that has not been space weathered and has not been affected by the lander’s exhaust. [1] Blake, D. F., Vaniman, D., Achilles, C., Anderson, R., Bish, D., et al. (2012). Space Sci. Rev. 170, 341-478. https://doi.org/10.1007/s11214-012-9905-1. [2] Zacny, K., Betts, B., Hedlund, M., Long, P., Gramlich, M., Tura, K., Chu, P., Jacob, A., Garcia, A. (2014). IEEE Aerospace Conference, 3-7 March 2014, Big Sky, MT, U.S.A.

X-ray diffraction↗

NASA metric transition plan

NASA science publications have used the metric system of measurement since 1970. Although NASA has maintained a metric use policy since 1979, practical constraints have restricted actual use of metric units. In 1988, an amendment to the Metric Conversion Act of 1975 required the Federal Government to adopt the metric system except where impractical. In response to Public Law 100-418 and Executive Order 12770, NASA revised its metric use policy and developed this Metric Transition Plan. NASA's goal is to use the metric system for program development and functional support activities to the greatest practical extent by the end of 1995. The introduction of the metric system into new flight programs will determine the pace of the metric transition. Transition of institutional capabilities and support functions will be phased to enable use of the metric system in flight program development and operations. Externally oriented elements of this plan will introduce and actively support use of the metric system in education, public information, and small business programs. The plan also establishes a procedure for evaluating and approving waivers and exceptions to the required use of the metric system for new programs. Coordination with other Federal agencies and departments (through the Interagency Council on Metric Policy) and industry (directly and through professional societies and interest groups) will identify sources of external support and minimize duplication of effort.

Source record↗

Exploratory Precipitation Metrics: Spatiotemporal Characteristics, Process-Oriented, and Phenomena-Based

Abstract Precipitation sustains life and supports human activities, making its prediction one of the most societally relevant challenges in weather and climate modeling. Limitations in modeling precipitation underscore the need for diagnostics and metrics to evaluate precipitation in simulations and predictions. While routine use of basic metrics is important for documenting model skill, more sophisticated diagnostics and metrics aimed at connecting model biases to their sources and revealing precipitation characteristics relevant to how model precipitation is used are critical for improving models and their uses. This paper illustrates examples of exploratory diagnostics and metrics including 1) spatiotemporal characteristics metrics such as diurnal variability, probability of extremes, duration of dry spells, spectral characteristics, and spatiotemporal coherence of precipitation; 2) process-oriented metrics based on the rainfall–moisture coupling and temperature–water vapor environments of precipitation; and 3) phenomena-based metrics focusing on precipitation associated with weather phenomena including low pressure systems, mesoscale convective systems, frontal systems, and atmospheric rivers. Together, these diagnostics and metrics delineate the multifaceted and multiscale nature of precipitation, its relations with the environments, and its generation mechanisms. The metrics are applied to historical simulations from phases 5 and 6 of the Coupled Model Intercomparison Project. Models exhibit diverse skill as measured by the suite of metrics, with very few models consistently ranked as top or bottom performers compared to other models in multiple metrics. Analysis of model skill across metrics and models suggests possible relationships among subsets of metrics, motivating the need for more systematic analysis to understand model biases for informing model development.

54 ENVIRONMENTAL SCIENCES↗

Candidate control design metrics for an agile fighter

Success in the fighter combat environment of the future will certainly demand increasing capability from aircraft technology. These advanced capabilities in the form of superagility and supermaneuverability will require special design techniques which translate advanced air combat maneuvering requirements into design criteria. Control design metrics can provide some of these techniques for the control designer. Thus study presents an overview of control design metrics and investigates metrics for advanced fighter agility. The objectives of various metric users, such as airframe designers and pilots, are differentiated from the objectives of the control designer. Using an advanced fighter model, metric values are documented over a portion of the flight envelope through piloted simulation. These metric values provide a baseline against which future control system improvements can be compared and against which a control design methodology can be developed. Agility is measured for axial, pitch, and roll axes. Axial metrics highlight acceleration and deceleration capabilities under different flight loads and include specific excess power measurements to characterize energy meneuverability. Pitch metrics cover both body-axis and wind-axis pitch rates and accelerations. Included in pitch metrics are nose pointing metrics which highlight displacement capability between the nose and the velocity vector. Roll metrics (or torsion metrics) focus on rotational capability about the wind axis.

Murphy, Patrick C.↗

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗

Metrication study for large space telescope

Various approaches which could be taken in developing a metric-system design for the Large Space Telescope, considering potential penalties on development cost and time, commonality with other satellite programs, and contribution to national goals for conversion to the metric system of units were investigated. Information on the problems, potential approaches, and impacts of metrication was collected from published reports on previous aerospace-industry metrication-impact studies and through numerous telephone interviews. The recommended approach to LST metrication formulated in this study cells for new components and subsystems to be designed in metric-module dimensions, but U.S. customary practice is allowed where U.S. metric standards and metric components are not available or would be unsuitable. Electrical/electronic-system design, which is presently largely metric, is considered exempt from futher metrication. An important guideline is that metric design and fabrication should in no way compromise the effectiveness of the LST equipment.

Creswick, F. A.↗

An Impedance-Based Complexity Metric for Unmanned Aircraft System Traffic Scenario Classification

This paper introduces an impedance-based metric to capture the complexity of a given unmanned aircraft system traffic scenario. The metric accounts for both the number of aircraft and the traffic flow pattern. The work presented here extends an earlier approach that introduced another scenario complexity metric based on the number of potential conflicts weighted by the conflict resolution cost associated. Complexity measurements for randomly-generated scenarios were produced through high-fidelity fast-time simulations and treated as baseline. Then the impedance based metric was evaluated, for the same scenarios, without the need for an actual flight simulation and a conflict resolution method. The results show that the impedance-based metric has a strong correlation to the baseline data and performs marginally better than the weighted conflict-based complexity metric introduced in the earlier work. The metric computation generates impedance maps which are useful for identifying high complexity regions in a scenario, where flight plan changes might be necessitated. This metric can therefore be used, in conjunction with other complexity metrics, to inform adequate traffic management strategies and classify a traffic scenario as acceptable, unacceptable or acceptable with changes made to flight plans that pass through the high complexity regions. The metric can also be used as a guidance metric for strategic conflict management methods.

Complexity↗

Goal-Driven Definition of Product Metrics Based on Properties

Defining product metrics requires a rigorous and disciplined approach, because useful metrics depend, to a very large extent, on one's goals and assumptions about the studied software process. Unlike in more mature scientific fields, it appears difficult to devise a "universal" set of metrics in software engineering, that can be used across application environments. We propose an approach for the definition of product metrics which is driven by the experimental goals of measurement, expressed via the Goal/Question/Metric (GQM) paradigm, and is based on the mathematical properties of the metrics. This approach integrates several research contributions from the literature into a consistent, practical and rigorous approach. The approach we outline should not be considered as a complete and definitive solution, but as a starting point for discussion about a product metric definition approach widely accepted in the software engineering community. At this point, we intend to provide an intellectual process that we think is necessary to define sound software product metrics. A precise and complete documentation of such an approach will provide the information needed to make the assessment and reuse of a new metric possible. Thus, product metrics are supported by a solid theory which facilitates their review and refinement. Moreover, their definition is made less exploratory and, as a consequence, one is less likely to identify spurious correlations between process and product metrics.

Briand, Lionel↗

A Contrast in Use of Metrics in Earth Science Data Systems

In recent years there has been a surge in the number of systems for processing, archiving and distributing remotely sensed data. Such systems, working independently as well as in collaboration, have been contributing greatly to the advances in the scientific understanding of the Earth system, as well as utilization of the data for nationally and internationally important applications. Among such systems, we consider those that are developed by or under the sponsorship of NASA to fulfill one of its strategic objectives: "Study Earth from space to advance scientific understanding and meet societal needs." NASA's Earth science data systems are of varying size and complexity depending on the requirements they are intended to meet. Some data systems are regarded as NASA's "Core Capabilities" that provide the basic infrastructure for processing, archiving and distributing a set of data products to a large and diverse user community in a robust and reliable manner. Other data systems constitute "Community Capabilities". These provide specialized and innovative services to data users and/or research products offering new scientific insight. Such data systems are generally supported by NASA through peer reviewed competition. Examples of Core Capabilities are 1. Earth Observing Data and Information System (EOSDIS) with its Distributed Active Archive Centers (DAACs), Science Investigator-led Processing Systems (SIPSs), and the EOS Clearing House (ECHO); 2. Tropical Rainfall Measurement Mission (TRMM) Science Data and Information System (TSDIS); 3. Ocean Data Processing System (ODPS); and 4. CloudSat Data Processing Center. Examples of Community Capabilities are projects under the Research, Education and Applications Solutions Network (REASON), and Advancing Collaborative Connections for Earth System Science (ACCESS) Programs. In managing these data system capabilities, it is necessary to have well-established goals and to measure progress relative to them. Progress is measured through "metrics", which can be a combination of quantitative as well as qualitative assessments. The specific metrics of interest depend on the user of the metrics as well as the type of data system. The users of metrics can be data system managers, program managers, funding agency or the public. Data system managers need metrics for assessing and improving the performance of the system and for future planning. Program managers need metrics to assess progress and the value of the data systems sponsored by them. Also, there is a difference in the metrics needed for core capabilities that tend to be more complex, larger and longer-term compared to community capabilities and the community capabilities that tend to be simpler, smaller and shorter-term. Even among community capabilities there are differences; hence the same set of metrics does not apply to all. Some provide data products to users, some provide services that enable better utilization of data or interoperability among other systems, and some are a part of a larger project where provision of data or services is only a minor activity. There is also a contrast between metrics used for internal and external purposes. Examples of internal purposes are: ensuring that the system meets its requirements, and planning for evolution and growth. Examples of external purposes are: providing to sponsors indicators of success of the systems, demonstrating the contributions of the system to overall program success, etc. This paper will consider EOSDIS, REASON and ACCESS programs to show the various types of metrics needed and how they need to be tailored to the types of data systems while maintaining the overall management goals of measuring progress and contributions made by the data systems.

Ramapriyan, Hampapuram↗

Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness

In black-box testing, the tester creates a set of tests to exercise a system under test without regard to the internal structure of the system. Generally, no objective metric is used to measure the adequacy of black-box tests. In recent work, we have proposed three requirements coverage metrics, allowing testers to objectively measure the adequacy of a black-box test suite with respect to a set of requirements formalized as Linear Temporal Logic (LTL) properties. In this report, we evaluate the effectiveness of these coverage metrics with respect to fault finding. Specifically, we conduct an empirical study to investigate two questions: (1) do test suites satisfying a requirements coverage metric provide better fault finding than randomly generated test suites of approximately the same size?, and (2) do test suites satisfying a more rigorous requirements coverage metric provide better fault finding than test suites satisfying a less rigorous requirements coverage metric? Our results indicate (1) only one coverage metric proposed -- Unique First Cause (UFC) coverage -- is sufficiently rigorous to ensure test suites satisfying the metric outperform randomly generated test suites of similar size and (2) that test suites satisfying more rigorous coverage metrics provide better fault finding than test suites satisfying less rigorous coverage metrics.

Staats, Matt↗

Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC): A Payload Designed for Exploration of Terrestrial Planetary Bodies

Geological materials (indeed, all solid objects) are characterized by their crystal structure, elemental composition, and morphology. The Mineralogical, Elemental, and Tomographic Reconnaissance Investigation for CLPS (METRIC) instrument suite quantifies all three. These measurements address fundamental science questions (e.g., the origin and evolution of planetary bodies) and support the human exploration of space (e.g., the characterization of regolith for ISRU and the constraint of its geotechnical properties). METRIC comprises an X-ray Diffraction/X-ray Fluorescence instrument (XRD: mineral structure and XRF: elemental composition), an X-ray micro-Computed Tomography instrument (XCT: 3D internal micromorphology), and a hyperspectral imaging infrared spectrometer (IRS) to provide local/regional mineralogic context for these measurements. METRIC XRD/F draws heritage from the highly successful Mars Science Laboratory CheMin instrument. The METRIC XRD/F employs two separate sample cells, one optimized for XRD and one for XRF, resulting in more rapid XRD analysis (tens of minutes vs. tens of hours for CheMin) and an orders-of-magnitude improvement in XRF detection. XCT has not been deployed in space, so the METRIC XCT represents a new capability for solar system exploration. The XCT uses the same basic high-TRL components as METRIC XRD/F, decreasing its development cost for flight. The METRIC IRS is a derivative of the NASA Earth Science Technology Office funded Hyperspectral Thermal Imager instrument and utilizes the NASA Technology Transfer Program to incorporate a commercial-of-the-shelf infrared camera ruggedized for space by NASA Marshall Space Flight Center. The IRS spectral range (8–14 µm) and resolution (10.8 cm -1 ) are tailored to quantify mineralogy in rocks using their characteristic Reststrahlen bands and to characterize mineralogy of soils using the position of the Christensen Feature. The METRIC payload is currently designed for deployment to the Moon on a Commercial Lunar Payload Services (CLPS) mission, where the XRD/F and XCT would be located on a lander and the IRS would be on deployed on a companion rover to evaluate the mineralogical diversity of the landing site. A pneumatic drill designed by Honeybee Robotics would excavate regolith up to 50 cm below the lander and deliver multiple aliquots of regolith to the XRD/F and XCT. The METRIC payload could also be deployed on a rover. In this case, a sample handling system on a robotic arm could scoop regolith and/or drill rocks and deliver powder to the XRD/F and XCT located in the rover’s interior. Alternatively, METRIC instruments could be used singly or in combination on human space missions. The XRD/F and XCT could be used to characterize samples in a rover or in a science laboratory within a habitat. These data could help astronauts identify resource-enriched rocks and regolith and triage geologic samples to return samples of high interest for analysis in terrestrial laboratories. The IRS could be attached to a human-navigated rover to collect mineralogical data along a traverse and identify high-priority science samples.

E. B. Rampe↗

Toward Human-Centric Transportation and Energy Metrics: Influence of Mode, Vehicle Occupancy, Trip Distance, and Fuel Economy

Traditional metrics measuring transportation and energy outcomes can be augmented to better represent impacts on people's lives and systems-level performance. In this context, this study introduces two novel metrics: road capacity (as number of people traveling and accessing services) and energy intensity (as energy use for people traveling and accessing services). Current national-level distributions of available data in the United States for factors contributing to the two new integrated metrics are used as context to evaluate potential outcomes. These factors include vehicle occupancy, mode share, fuel economy, and trip distance. Variations in input values provide insights on how these factors shape efficiencies in road capacity and energy intensity. Parametric sensitivity analysis indicates that the impact of each input depends upon the metric being evaluated. For the human-centered road capacity mobility metric, increasing vehicle occupancy has the largest effect &ndash; twice that of increasing mode share for bike, walk, and transit. For the energy intensity mobility metric, the effect of improving fuel economy is the largest. However, when the focus is on accessibility (instead of mobility), for both metrics the effect of lowering average trip distance is the largest. Additionally, a novel interactive tool to visualize the results for various parameter combinations makes the metrics practitioner ready. The findings suggest that the diffusion of new human-centric metrics that benchmark outcomes associated with road capacity and energy may be significant in motivating new sustainable transportation investments and efficient utilization of infrastructure, mobility assets, and services.

ADVANCED PROPULSION SYSTEMS↗