Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Modeling of composite beams and plates for static and dynamic analysis

A rigorous theory and the corresponding computational algorithms were developed for through-the-thickness analysis of composite plates. This type of analysis is needed in order to find the elastic stiffness constants of a plate. Additionally, the analysis is used to post-process the resulting plate solution in order to find approximate three-dimensional displacement, strain, and stress distributions throughout the plate. It was decided that the variational-asymptotical method (VAM) would serve as a suitable framework in which to solve these types of problems. Work during this reporting period has progressed along two lines: (1) further evaluation of neo-classical plate theory (NCPT) as applied to shear-coupled laminates; and (2) continued modeling of plates with nonuniform thickness.

Hodges, Dewey H.↗

Damage Tolerance of Composites

Fracture control requirements have been developed to address damage tolerance of composites for manned space flight hardware. The requirements provide the framework for critical and noncritical hardware assessment and testing. The need for damage threat assessments, impact damage protection plans, and nondestructive evaluation are also addressed. Hardware intended to be damage tolerant have extensive coupon, sub-element, and full-scale testing requirements in-line with the Building Block Approach concept from the MIL-HDBK-17, Department of Defense Composite Materials Handbook.

Hodge, Andy↗

Two Decades Observing Smoke Above Clouds in the South-Eastern Atlantic Ocean: Deep Blue Algorithm Updates and Validation with ORACLES Field Campaign Data

This study presents and evaluates an updated algorithmfor quantification of absorbing aerosols above clouds(AACs) from passive satellite measurements. The focus isbiomass burning in the south-eastern Atlantic Ocean duringthe 2016 and 2017 ObseRvations of Aerosols above CLoudsand their intEractionS (ORACLES) field campaign deployments.The algorithm retrieves the above-cloud aerosoloptical depth (AOD) and underlying liquid cloud opticaldepth and is applied to measurements from the Sea-viewingWide Field-of-view Sensor (SeaWiFS), Moderate ResolutionImaging Spectroradiometer (MODIS), and Visible InfraredImaging Radiometer Suite (VIIRS) from 1997 to 2017. AirborneNASA Ames Spectrometers for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) and NASA LangleyHigh Spectral Resolution Lidar 2 (HSRL2) data collectedduring ORACLES provide important validation for spectralAOD for MODIS and VIIRS; as the SeaWiFS missionended in 2010, it cannot be evaluated directly. The 4STARand HSRL2 comparisons are complementary and reveal performancegenerally in line with uncertainty estimates providedby the optimal estimation retrieval framework used. Atpresent the two MODIS-based data records seem the mostreliable, although there are differences between the deployments,which may indicate that the available data are not yetsufficient to provide a robust regional validation. Spatiotemporalpatterns in the data sets are similar, and the time seriesare very strongly correlated with each other (correlationcoefficients from 0.95 to 0.99). Offsets between the satellitedata sets are thought to be chiefly due to differences in absolutecalibration between the sensors. The available validationdata for this type of algorithm are limited to a small numberof field campaigns, and it is strongly recommended that suchairborne measurements continue to be made, both over thesouthern Atlantic Ocean and elsewhere.

Sayer, Andrew M.↗

PRELIMINARY MODEL FOR SOIL MOISTURE RETRIEVAL USING P-BAND RADIOMETER OBSERVATIONS

Soil Moisture is an important geophysical variable that needs reliable quantification for applications in hydrology, meteorology and agriculture. L-band radiometry has proved to be one of the best methods in soil moisture estimation using microwave signals. However, they provide measurements that correspond to a shallow depth of 5 cm and are also affected by the presence of overlaying vegetation and roughness. In contrast, P-band radiometry is expected to provide moisture information on a deeper layer of soil. Moreover, these lower frequency measurements are expected to be less affected by soil roughness and vegetation contributions. Consequently, this pilot study uses the Polarimetric P-band Multi beam Radiometer(PPMR) at 740 MHz to evaluate the response of theP-band radiometer over a realistic range of surface condition sat the field scale. A preliminary framework of P-band MicrowaveEmission of theBiosphere (P-MEB) has been developed as a forward model that simulates brightness temperature from soil moisture and other ancillary data collected from the field. This paper presents the model for the bare soil condition observed during June 2018 to August 2018. The results show that H-polarized PPMR data has better correlation to the soil moisture over a depth of 10 cm than the V-polarized PPMR data. A model is under improvement by incorporating a more suitable effective temperature formulation.

Edward J Kim↗

Data Augmentation for Intelligent Contingency Management Using Generative Adversarial Neural Networks

Artificial intelligence (AI)-based techniques for intelligent contingency management (ICM) require that intelligent agents learn various aspects of system dynamics to create and execute contingencies. For high assurance contingency management, agents achieve the most compelling results through supervised or semi-supervised machine learning, for which agents require large datasets to learn the dynamics of the system. Unfortunately, data collection in aerospace applications can be costly, due to both time and resources. Presented work describes a framework for data augmentation of ICM databases containing training data for machine learning models. This framework populates the database with the outputs of generative adversarial network (GAN) models that were trained on flight data. Methods for evaluating the suitability of these models based on the equations of motion, as well as other physical constraints, are discussed. The paper demonstrates the utility of this database for training intelligent agents on the NASA T2 generic transport aircraft model and experimental vertical takeoff and landing (VTOL) simulation model.

Generative Machine Learning↗

Data Augmentation for Intelligent Contingency Management Using Generative Adversarial Neural Networks

Artificial intelligence (AI)-based techniques for intelligent contingency management (ICM) require that intelligent agents learn various aspects of system dynamics to create and execute contingencies. For high assurance contingency management, agents achieve the most compelling results through supervised or semi-supervised machine learning, for which agents require large datasets to learn the dynamics of the system. Unfortunately, data collection in aerospace applications can be costly, due to both time and resources. Presented work describes a framework for data augmentation of ICM databases containing training data for machine learning models. This framework populates the database with the outputs of generative adversarial network (GAN) models that were trained on flight data. Methods for evaluating the suitability of these models based on the equations of motion, as well as other physical constraints, are discussed. The paper demonstrates the utility of this database for training intelligent agents on the NASA T2 generic transport aircraft model and experimental vertical takeoff and landing (VTOL) simulation model.

Generative Machine Learning↗

Wall-Modeled Large-Eddy Simulations of a Swept Wing with Leading-Edge Ice

The aerodynamic performance of a swept wing derived from the Common Research Model wing with high-fidelity and smooth leading-edge ice shapes is evaluated using wall-modeled large-eddy simulations. Two mesh paradigms are considered within the Launch, Ascent, and Vehicle Aerodynamics framework: structured hybrid curvilinear body-fitted/immersed-boundary and unstructured Voronoi. The curvilinear approach models the effect of the ice on the flow through penalty terms and the Voronoi strategy includes the ice representation directly in the mesh.Aerodynamic loads, surface pressure profiles, and skin-friction streamlines are compared against experimental results collected at the Wichita State University wind tunnel at a Mach number of 0.18 and a Reynolds number per mean aerodynamic chord of 1.6 million. For the curvilinear simulations with high-fidelity ice, results are sensitive to spanwise mesh resolution near the leading edge, where insufficient spanwise resolution leads to a spanwise running vortexaft of the high-fidelity ice, which is partially removed with increasing spanwise resolution. For the Voronoi simulations with high-fidelity ice, refining the mesh led to good convergence towards the experimental results with the best case demonstrating a maximum discrepancy of three lift counts relative to the experiment across a range of angles of attack from about 5 to 24 degrees, validating the shrink-wrapping procedure used for the ice. For the smooth ice, the curvilinear approach consistently under-predicted the upper surface suction leading to an under-prediction in lift, but did not demonstrate the pronounced over-prediction in upper surface suction near the leading edge observed in the Voronoi simulations.

AATT↗

Integral Twist Actuation of Helicopter Rotor Blades for Vibration Reduction

Active integral twist control for vibration reduction of helicopter rotors during forward flight is investigated. The twist deformation is obtained using embedded anisotropic piezocomposite actuators. An analytical framework is developed to examine integrally-twisted blades and their aeroelastic response during different flight conditions: frequency domain analysis for hover, and time domain analysis for forward flight. Both stem from the same three-dimensional electroelastic beam formulation with geometrical-exactness, and axe coupled with a finite-state dynamic inflow aerodynamics model. A prototype Active Twist Rotor blade was designed with this framework using Active Fiber Composites as the actuator. The ATR prototype blade was successfully tested under non-rotating conditions. Hover testing was conducted to evaluate structural integrity and dynamic response. In both conditions, a very good correlation was obtained against the analysis. Finally, a four-bladed ATR system is built and tested to demonstrate its concept in forward flight. This experiment was conducted at NASA Langley T~ansonic Dynamics Tunnel and represents the first-of-a-kind Mach-scaled fully-active-twist rotor system to undergo forward flight test. In parallel, the impact upon the fixed- and rotating-system loads is estimated by the analysis. While discrepancies are found in the amplitude of the loads under actuation, the predicted trend of load variation with respect to its control phase correlates well. It was also shown, both experimentally and numerically, that the ATR blade design has the potential for hub vibratory load reduction of up to 90% using individual blade control actuation. Using the numerical framework, system identification is performed to estimate the harmonic transfer functions. The linear time-periodic system can be represented by a linear time-invariant system under the three modes of blade actuation: collective, longitudinal cyclic, and lateral cyclic. A vibration minimizing controller is designed based on this result, which implements classical disturbance rejection algorithm with some modifications. The controller is simulated numerically, and more than 90% of the 4P hub vibratory load is eliminated. By accomplishing the experimental and analytical steps described in this thesis, the present concept is found to be a viable candidate for future generation low-vibration helicopters. Also, the analytical framework is shown to be very appropriate for exploring active blade designs, aeroelastic behavior prediction, and as simulation tool for closed-loop controllers.

Shin, SangJoon↗

Project-domain Science Traceability and Alignment Framework (P-STAF): Analysis of a Payload Architecture

Large science-focused space missions often have multiple instruments working together to address broad science goals. Systems engineers on these types of projects must work with the project scientists to evaluate trades and make decisions that result in a system that efficiently serves the mission science goals. This collaboration is more effective if the systems engineers understand both the traceability from the L1 customer requirements to the selected instruments and the contributions of each instrument in the context of the whole payload suite. These relationships might be understood implicitly by the science team on a project, but there is value in formally codifying them so this understanding can be accessed and formally analyzed by a broader systems engineering effort. We first described a framework for this communication, called the Project-domain Science Traceability and Alignment Framework (P-STAF), in the IEEE 2017 paper “A Framework for Extending the Science Traceability Matrix: Application to the Planned Europa Mission.” This paper shows how that basic framework can be leveraged to not only formally capture these relationships between the instruments and the customer needs, but also how that information can be codified in an analyzable graph that can be queried to provide a better understanding of mission risks and scope. This work was drawn from the application of P-STAF to the Europa Clipper mission, but generic example networks are used to illustrate the power of this technique.

Reinholtz, Kirk↗

A Systems Engineering Approach to Architecture Development

Architecture development is often conducted prior to system concept design when there is a need to determine the best-value mix of systems that works collectively in specific scenarios and time frames to accomplish a set of mission area objectives. While multiple architecture frameworks exist, they often require use of unique taxonomies and data structures. In contrast, this paper characterizes architecture development using terminology widely understood within the systems engineering community. Using a notional civil space architecture example, it employs a multi-tier framework to describe the enterprise level architecture and illustrates how results of lower tier, mission area architectures integrate into the enterprise architecture. It also presents practices for conducting effective mission area architecture studies, including establishing the trade space, developing functions and metrics, evaluating the ability of potential design solutions to meet the required functions, and expediting study execution through the use of iterative design cycles.

Multi-tier Framework↗

Selection of a Data Acquisition and Controls System Communications and Software Architecture for Johnson Space Center's Space Environment Simulation Laboratory Thermal and Vacuum Test Facilities

Upgrade of data acquisition and controls systems software at Johnson Space Center's Space Environment Simulation Laboratory (SESL) involved the definition, evaluation and selection of a system communication architecture and software components. A brief discussion of the background of the SESL and its data acquisition and controls systems provides a context for discussion of the requirements for each selection. Further framework is provided as upgrades to these systems accomplished in the 1990s and in 2003 are compared to demonstrate the role that technological advances have had in their improvement. Both of the selections were similar in their three phases; 1) definition of requirements, 2) identification of candidate products and their evaluation and testing and 3) selection by comparison of requirement fulfillment. The candidates for the communication architecture selection embraced several different methodologies which are explained and contrasted. Requirements for this selection are presented and the selection process is described. Several candidates for the software component of the data acquisition and controls system are identified, requirements for evaluation and selection are presented, and the evaluation process is described.

Jordan, Eric A.↗

Elevation Change of the Southern Greenland Ice Sheet from Satellite Radar Altimeter Data

Long-term changes in the thickness of the polar ice sheets are important indicators of climate change. Understanding the contributions to the global water mass balance from the accumulation or ablation of grounded ice in Greenland and Antarctica is considered crucial for determining the source of the about 2 mm/yr sea-level rise in the last century. Though the Antarctic ice sheet is much larger than its northern counterpart, the Greenland ice sheet is more likely to undergo dramatic changes in response to a warming trend. This can be attributed to the warmer Greenland climate, as well as a potential for amplification of a global warming trend in the polar regions of the Northern Hemisphere. In collaboration with Drs. Curt Davis and Craig Kluever of the University of Missouri, we are using data from satellite radar altimeters to measure changes in the elevation of the Southern Greenland ice sheet from 1978 to the present. Difficulties with systematic altimeter measurement errors, particularly in intersatellite comparisons, beset earlier studies of the Greenland ice sheet thickness. We use altimeter data collected contemporaneously over the global ocean to establish a reference for correcting ice-sheet data. In addition, the waveform data from the ice-sheet radar returns are reprocessed to better determine the range from the satellite to the ice surface. At JPL, we are focusing our efforts principally on the reduction of orbit errors and range biases in the measurement systems on the various altimeter missions. Our approach emphasizes global characterization and reduction of the long-period orbit errors and range biases using altimeter data from NASA's Ocean Pathfinder program. Along-track sea-height residuals are sequentially filtered and backwards smoothed, and the radial orbit errors are modeled as sinusoids with a wavelength equal to one revolution of the satellite. The amplitudes of the sinusoids are treated as exponentially-correlated noise processes with a time-constant of six days. Measurement errors (e.g., altimeter range bias) are simultaneously recovered as constant parameters. The corrections derived from the global ocean analysis are then applied over the Greenland ice sheet. The orbit error and measurement bias corrections for different missions are developed in a single framework to enable robust linkage of ice-sheet measurements from 1978 to the present. In 1998, we completed our re-evaluation of the 1978 Seasat and 1985-1989 Geosat Exact Repeat Mission data. The estimates of ice thickness over Southern Greenland (south of 72N and above 2000 m) from 1978 to 1988 show large regional variations (+/-18 cm/yr), but yield an overall rate of +1.5 +/- 0.5 cm/yr (one standard error). Accounting for systematic errors, the estimate may not be significantly different from the null growth rate. The average elevation change from 1978 to 1988 is too small to assess whether the Greenland ice sheet is undergoing a long-term change.

Haines, Bruce J.↗

Message Brokering Evaluation for Live Spacecraft Telemetry Monitoring, Recorded Playback, and Analysis

Live monitoring and post-flight analysis of telemetry data play a vital role in the development, diagnosis, and deployment of components of a space flight mission. Requirements for such a system include low end-to-end latency between data producers and visualizers, preserved ordering of messages, data stream archiving with random access playback, and real-time creation of derived data streams. We evaluate the RabbitMQ and Kafka message brokering systems, on how well they can enable a real-time, scalable, and robust telemetry framework that delivers telemetry data to multiple clients across heterogeneous platforms and flight projects. In our experiments using an actively developed robotic arm testbed, Kafka yielded a much higher message throughput rate and a consistent publishing rate across the number of topics and consumers. Consumer message rates were consistent across the number of topics but can exhibit bursty behavior with an increase in the contention for a single topic partition with increasing number of consumers.

Lee, Daren↗

Dynamic Assurance of Autonomous Systems through Ground Control Software

Assurance cases are being increasingly acknowledged as a way to build trust in complex systems with autonomous capabilities [1]. An assurance case is a comprehensive, defensible, and valid justification that a system will function as intended for the specific mission and operating environment. Such justifications for systems with autonomous capabilities are often based on various probabilistic quantifications [2]. Due to the dynamic nature of the environmental conditions in which these systems operate, as well as the changing nature of the autonomous systems themselves, these probabilistic quantifications cannot be simply estimated once during design time. Rather, they need to be continually evaluated during systems operations to ensure that the assurance case justifications are valid. We refer to the assurance case that combines both the static and dynamic elements as a Dynamic Assurance Case (DAC). Such complex systems with autonomous capabilities are often deployed with a Ground Control Software (GCS) component to enable remote operation. Whether the system is composed of a single unit or a fleet of units, deployed distributed or in remote environments, GCS acts as a window into the behavior of the deployed system. It receives telemetry from the system, issues commands to the system and provides various functionalities to visualize the system performance. We propose a dynamic assurance framework where the GCS acts as a relay between the autonomous system and its DAC. GCS can be used to measure both unit-specific as well as system-wide probabilistic quantifications using the incoming telemetry. We embed these quantifications throughout the DAC as variables that can be updated by external sources. We use the GCS to periodically update these variables, which allows us to continually evaluate the formally defined assurance case justifications. We demonstrate our dynamic assurance framework in the NASA Ames project Troupe1 that aims at developing a fleet of rovers capable of au- tonomously mapping their environment. The rovers work cooperatively, each collecting data for different parts of the environment. Each rover runs an identical core Flight System (cFS) [4] application. Troupe1 uses OpenC3 Cosmos [5] as the ground system, and AdvoCATE [3] to capture the system DAC. We show how we can measure both rover-specific and system-wide quantifications in Cosmos using its Ruby scripting editor and pass them into the DAC modelled in AdvoCATE. Then, we show how these incoming variables can be embedded in different parts of the DAC and how effects of their updates can be observed

Irfan Sljivo↗

A Systems Engineering Approach to Architecture Development

Architecture development is conducted prior to system concept design when there is a need to determine the best-value mix of systems that works collectively in specific scenarios and time frames to accomplish a set of mission area objectives. While multiple architecture frameworks exist, they often require use of unique taxonomies and data structures. In contrast, this presentation characterizes architecture development using terminology widely understood within the systems engineering community. Using a notional civil space architecture example, it employs a multi-tier framework to describe the enterprise level architecture and illustrates how results of lower tier, mission area architectures integrate into the enterprise architecture. It also presents practices for conducting effective mission area architecture studies, including establishing the trade space, developing functions and metrics, evaluating the ability of potential design solutions to meet the required functions, and expediting study execution through the use of iterative design cycles.

Architecture Development↗

A Systems Engineering Approach to Architecture Development

Architecture development is often conducted prior to system concept design when there is a need to determine the best-value mix of systems that works collectively in specific scenarios and time frames to accomplish a set of mission area objectives. While multiple architecture frameworks exist, they often require use of unique taxonomies and data structures. In contrast, this paper characterizes architecture development using terminology widely understood within the systems engineering community. Using a notional civil space architecture example, it employs a multi-tier framework to describe the enterprise level architecture and illustrates how results of lower tier, mission area architectures integrate into the enterprise architecture. It also presents practices for conducting effective mission area architecture studies, including establishing the trade space, developing functions and metrics, evaluating the ability of potential design solutions to meet the required functions, and expediting study execution through the use of iterative design cycles

Architecture Development↗

Maximum-entropy probability distributions under Lp-norm constraints

Continuous probability density functions and discrete probability mass functions are tabulated which maximize the differential entropy or absolute entropy, respectively, among all probability distributions with a given L sub p norm (i.e., a given pth absolute moment when p is a finite integer) and unconstrained or constrained value set. Expressions for the maximum entropy are evaluated as functions of the L sub p norm. The most interesting results are obtained and plotted for unconstrained (real valued) continuous random variables and for integer valued discrete random variables. The maximum entropy expressions are obtained in closed form for unconstrained continuous random variables, and in this case there is a simple straight line relationship between the maximum differential entropy and the logarithm of the L sub p norm. Corresponding expressions for arbitrary discrete and constrained continuous random variables are given parametrically; closed form expressions are available only for special cases. However, simpler alternative bounds on the maximum entropy of integer valued discrete random variables are obtained by applying the differential entropy results to continuous random variables which approximate the integer valued random variables in a natural manner. All the results are presented in an integrated framework that includes continuous and discrete random variables, constraints on the permissible value set, and all possible values of p. Understanding such as this is useful in evaluating the performance of data compression schemes.

Dolinar, S.↗

Selecting Meteorological Input for the Global Modeling Initiative Assessments

The Global Modeling Initiative (GMI) science team has developed a three dimensional chemistry and transport model (CTM) to evaluate the impact of the exhaust of supersonic aircraft on the stratosphere. An important goal of the GMI is to test modules for numerical transport, photochemical integration, and model dynamics within a common framework. This work is focussed on the dependence of the overall assessment on the wind and temperature fields used by the CTM. Three meteorological data sets for the stratosphere were available to GMI: the National Center for Atmospheric Research Community Climate Model (CCM2), the Goddard Earth Observing System Data Assimilation System (GEOS-DAS), and the Goddard Institute for Space Studies general circulation model (GISS-2'). Objective criteria were established by the GMI team to evaluate which of these three data sets provided the best representation of trace gases in the stratosphere today. Tracer experiments were devised to test various aspects of model transport. Stratospheric measurements of long-lived trace gases were selected as a test of the CTM transport. This presentation describes the criteria used in grading the meteorological fields and the resulting choice of wind fields to be used in the GMI assessment. This type of objective model evaluation will lead to a higher level of confidence in these assessments. We suggest that the diagnostic tests shown here be used to augment traditional general circulation model evaluation methods.

Strahan, Susan↗