Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “independent evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

FluxSat: Long-term Earth Science Data Record (ESDR) for Terrestrial Gross Primary Production (GPP) based on satellite data calibrated with eddy covariance data

Gross primary production (GPP), the amount of carbon dioxide (CO 2 ) assimilated by plants through photosynthesis, is one of the most variable and uncertain components of the global carbon cycle. Global GPP has been estimated with a number of process-based models, data-driven, and hybrid approaches. Dynamic global vegetation models (DGVMs), driven by observed environmental changes, are used for global carbon budget assessments and long-term (climate) prediction. Benchmarking these and other models globally with data-driven GPP estimates is critical for understanding the land sink and ensuring accurate forecasts of the carbon cycle. In addition, global data-driven GPP estimates are crucial for studies of interannual variability, including trends that are linked to mechanisms with large uncertainties, such as the indirect CO 2 fertilization effect related to greening. In response to a community need for a GPP data set that well captures spatio-temporal variability, we developed FluxSat, a data-driven approach that optimizes the use of satellite reflectance data from the NASA MODerate-resolution Imaging Spectroradiometer (MODIS) on the Terra and Aqua satellites, calibrated using ground-based eddy covariance (EC) data. We are enhancing (spatially, higher resolution) and extending FluxSat (in time, with additional sensors) to create a high quality long term GPP Earth System Data Record (ESDR) for use in model benchmarking, carbon cycle modeling, and studies of trends and interannual variability. Our team’s objectives are to: 1. Update and document the current MODIS FluxSat GPP (daily, 0.05o and 0.5o resolutions) products with latest available MODIS and EC data sets; 2. Extend FluxSat GPP record forward in time with the Visible Infrared Imaging Radiometer Suite (VIIRS) on operational weather satellites going forward; 3. Extend FluxSat GPP record backward in time using the Advanced Very High Resolution Radiometer (AVHRR) on weather satellites dating back to 1981; 4. Provide higher spatial resolution MODIS and VIIRS GPP (0.0083o). 5. Thoroughly evaluate all FluxSat products with independent data; and 6. Create a homogenized long-term GPP record spanning 40+ years. We will discuss plans for this long-term data set that is supported through the NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) program.

gross Primary Production↗

NASA Engineering and Safety Center Lunar Rover Design Concepts Assessments

Mass is a significant risk to programs and projects as they transition from formulation to implementation, especially in larger human space systems where delivery mass or volume can be a constrained commodity. • Concepts developed without an adequate systems-engineering basis, including design and operations experience, may miss significant functionality and subsequent mass required for integration or operations. • Further uncertainty can be associated with not fully understanding design best practices and standards that drive mass, such as design for minimum risk or fault tolerance.1 • Finally, the appropriate systems engineering mass properties management rigor and technical discipline insight are required to set the mass baseline, including appropriate mass growth allowance (MGA) to ensure program success. Mass is a key quantity that should be constantly monitored by the systems engineer and the program/project management stakeholder to ensure mission compatibility throughout the project life cycle. In addition, mass is a key programmatic performance metric monitored by the NASA Chief Financial Officer for current and future program cost estimating. NASA Exploration Systems sought an assessment of reasonableness with respect to different potential rover concepts that balances mass needs and human-class cargo lander capabilities. Appropriate systems engineering mass properties management rigor and technical discipline insight were used, and are required to set the mass baseline, including appropriate MGA to ensure program success. Two independent Lunar rover concepts were evaluated, with a goal to understand concept credibility and the Lunar rover designs potential extensibility for Mars surface operations. A notional generic rover concept is shown in Figure 1.

Systems Engineering↗

Bio-project “derisking” through development of systematic methodologies and frameworks for risk assessment

One of the primary hindrances to producing a viable, sustainable domestic biomass industry for renewable biofuels, bio-products and bio-power is the lack of understanding and quantification of the risks associated with both the biomass supply chain and preprocessing and conversion technologies. Currently a consistent method for assessing, comparing, and quantifying risks in biomass supply chains does not exist, creating a major investment barrier to bioenergy projects in the U.S. The lack of a standardized approach has resulted in bioenergy stakeholders independently using inconsistent approaches and evaluation criteria, leading to unreliable and incomparable assessments of risks and financing barriers to bio-project development. Along with the challenges of inconsistent risk assessment for supply chain risk, technology specific risks based on variability in biomass properties are not fully understood and can pose significant unforeseen challenges for bioenergy projects. In many cases these properties have not yet been identified and the impacts on the proposed technology and products unquantified. This is particularly challenging for emerging preprocessing and conversion technologies. Without a firm understanding of the preprocessing/conversion technology-specific critical properties, the risk of a proposed bio-project cannot be fully evaluated. To address inconsistent risk evaluation in the biomass supply chain supporting project financing, a Biomass Supply Chain Risk Standards (BSCRS) framework was developed. The BSCRS framework includes a comprehensive list of known and perceived risks (Risk Indicators) to the supply chain developed through 100’s of interviews with bioenergy industry experts spanning from feedstock growers and suppliers to representatives from the financial sector. These risks have been organized into a manageable hierarchy of Risk Categories and Risk Factors that can be practically assessed. This BSCRS framework also provides mitigation strategies for multiple Risk Indicators from best available industry practices and research findings. Additionally, a risk quantification methodology for each Risk Factor, Risk Category, and the bio-project as a whole was developed to enable capital markets to assess feedstock risk more efficiently and more accurately. Multiple case studies representing existing bio-projects have been used to evaluate and verify the BSCRS framework and scoring methodology. To address technological risk along with the supply chain risk captured in the developed BSCRS framework, this work also focuses on development of a systematic criticality assessment tool using well-accepted, quantitative risk analysis methods to evaluate bioenergy feedstock critical properties impacting system unit operations. The proposed Failure Mode and Effect Analysis (FMEA) approach uses a team of subject area experts (SAEs) for each targeted unit operation within a system. Collectively, the team will develop and use a quantitative scoring system to assess the material attributes, process parameters, and quality attributes for key unit operations that have already been identified. The FMEA process generates Risk Priority Numbers (RPNs) for the various failures and predominant causes for each material/process unit/product combination resulting in a semi-quantitative, standardized methodology for assessing technological risk and biomass properties contributing to that risk.

09 BIOMASS FUELS↗

Regularized Differentiation for Bioburden Density Estimation in Planetary Protection

In this paper, we propose and investigate the performance of two novel shrinkage estimators for bioburden density estimation in planetary protection. The estimators are based on the regularized differentiation of a cumulative count of colony forming units collected throughout the data collecting session or the life cycle of the entire mission. The regularized differentiation recasts the problem of bioburden density estimation as a linear least squares problem. The least squares problem is then solved through regularization techniques, such as truncated singular value decomposition and penalized least squares. The regularization is necessary to avoid noise amplification during the differentiation of noisy data. The two regularization estimators are compared with four other commonly used estimators to simultaneously evaluate the means of multivariable independent Poisson distributions: the maximum likelihood, noninformative Bayes estimator with Jeffreys prior, Empirical Bayes using conjugate gamma-Poisson model with gamma parameters selected by method of moments, and the Clevenson-Zidek estimator. It is shown through computer-simulated data that the regularized differentiation based on ridge regression has the smallest mean-squared error among all estimators. The analysis of shrinkage mechanism implemented by regularized differentiation is performed, and it is shown that the regularized differentiation amounts to performing a weighted averaging of all the samples. The weights are determined by the regularization parameter automatically selected by the L-curve technique. Since the method of least squares makes no distributional assumptions about the data, it presents an attractive technique for bioburden density estimation when there are concerns about the misspecification of the distributional model. The paper concludes with the analysis of the bioburden data collected during InSight mission and directions for future work.

97 - MATHEMATICS AND COMPUTING↗

Error estimation and adaptive mesh refinement for parallel analysis of shell structures

The formulation and application of element-level, element-independent error indicators is investigated. This research culminates in the development of an error indicator formulation which is derived based on the projection of element deformation onto the intrinsic element displacement modes. The qualifier 'element-level' means that no information from adjacent elements is used for error estimation. This property is ideally suited for obtaining error values and driving adaptive mesh refinements on parallel computers where access to neighboring elements residing on different processors may incur significant overhead. In addition such estimators are insensitive to the presence of physical interfaces and junctures. An error indicator qualifies as 'element-independent' when only visible quantities such as element stiffness and nodal displacements are used to quantify error. Error evaluation at the element level and element independence for the error indicator are highly desired properties for computing error in production-level finite element codes. Four element-level error indicators have been constructed. Two of the indicators are based on variational formulation of the element stiffness and are element-dependent. Their derivations are retained for developmental purposes. The second two indicators mimic and exceed the first two in performance but require no special formulation of the element stiffness mesh refinement which we demonstrate for two dimensional plane stress problems. The parallelizing of substructures and adaptive mesh refinement is discussed and the final error indicator using two-dimensional plane-stress and three-dimensional shell problems is demonstrated.

Keating, Scott C.↗

Independent Reliability Assessment and Progress Review of the NASA GSFC Laser Transmitter for the LISA Program

NASA Goddard Space Flight Center (GSFC) has been actively developing the laser transmitter for the Laser Interferometer Space Antenna (LISA) program since the late 2017. In 2021 we delivered a prototype laser transmitter to the LISA program for performance evaluation as well as performed an independent technology assessment on the laser design supported by the NASA Engineering and Safety Center (NESC). We continued to further develop the LISA laser with a goal of advancing the technology readiness level (TRL) of the laser to 6 by the end of 2023. In this paper, we report on the progress we made on the laser development for the LISA program as well as the technology assessment findings by the NESC.

Independent Reliability Assessment↗

Boosting the External Quantum Efficiency of AlGaN-Based Metal–Semiconductor–Metal Ultraviolet Photodiodes by Electrode Geometry Variation

Fast aluminum-gallium-nitride–based metal–semiconductor–metal ultraviolet photodiodes were successfully designed, fabricated, and characterized using conventional photolithography techniques. Various electrode geometries were fabricated to investigate the influence of metal contact shapes on the device performance indices with emphasis on the response speed and bias-voltage–independent efficiency. Furthermore, based on the independently measured Hall mobility and electric field, we evaluated the carrier transit time of the devices as 1.31 ps with bias-voltage–independent external quantum efficiency of 1198% in photoconductive mode at 19.5 V and 70% at 60 V for n -doped and intrinsic devices, respectively.

42 ENGINEERING↗

Using a data base management system for modelling SSME test history data

The usefulness of a data base management system (DBMS) for modelling historical test data for the complete series of static test firings for the Space Shuttle Main Engine (SSME) was assessed. From an analysis of user data base query requirements, it became clear that a relational DMBS which included a relationally complete query language would permit a model satisfying the query requirements. Representative models and sample queries are discussed. A list of environment-particular evaluation criteria for the desired DBMS was constructed; these criteria include requirements in the areas of user-interface complexity, program independence, flexibility, modifiability, and output capability. The evaluation process included the construction of several prototype data bases for user assessement. The systems studied, representing the three major DBMS conceptual models, were: MIRADS, a hierarchical system; DMS-1100, a CODASYL-based network system; ORACLE, a relational system; and DATATRIEVE, a relational-type system.

Abernethy, K.↗

Machine Learning Techniques in Optimal Design

Many important applications can be formalized as constrained optimization tasks. For example, we are studying the engineering domain of two-dimensional (2-D) structural design. In this task, the goal is to design a structure of minimum weight that bears a set of loads. A solution to a design problem in which there is a single load (L) and two stationary support points (S1 and S2) consists of four members, E1, E2, E3, and E4 that connect the load to the support points is discussed. In principle, optimal solutions to problems of this kind can be found by numerical optimization techniques. However, in practice [Vanderplaats, 1984] these methods are slow and they can produce different local solutions whose quality (ratio to the global optimum) varies with the choice of starting points. Hence, their applicability to real-world problems is severely restricted. To overcome these limitations, we propose to augment numerical optimization by first performing a symbolic compilation stage to produce: (a) objective functions that are faster to evaluate and that depend less on the choice of the starting point and (b) selection rules that associate problem instances to a set of recommended solutions. These goals are accomplished by successive specializations of the problem class and of the associated objective functions. In the end, this process reduces the problem to a collection of independent functions that are fast to evaluate, that can be differentiated symbolically, and that represent smaller regions of the overall search space. However, the specialization process can produce a large number of sub-problems. This is overcome by deriving inductively selection rules which associate problems to small sets of specialized independent sub-problems. Each set of candidate solutions is chosen to minimize a cost function which expresses the tradeoff between the quality of the solution that can be obtained from the sub-problem and the time it takes to produce it. The overall solution to the problem, is then obtained by solving in parallel each of the sub-problems in the set and computing the one with the minimum cost. In addition to speeding up the optimization process, our use of learning methods also relieves the expert from the burden of identifying rules that exactly pinpoint optimal candidate sub-problems. In real engineering tasks it is usually too costly to the engineers to derive such rules. Therefore, this paper also contributes to a further step towards the solution of the knowledge acquisition bottleneck [Feigenbaum, 1977] which has somewhat impaired the construction of rulebased expert systems.

Cerbone, Giuseppe↗

The interpretation of flying qualities requirements for flight control system design

An experimental flight test program was designed for the Total In Flight Simulator (TIFS) directed toward the interface between flying qualities requirements and flight control system design criteria. The eventual goal is to provide an interpretation or translation of flying qualities requirements for use by the flight control system designer. Specifically, an angle of attack and pitch rate command system matrix involving both short term and long term dynamics are specified for evaluation. Flying qualities criteria and flight control system configuration or architecture can be independent was demonstrated. Finally, additional configurations are proposed to evaluate the efficacy of dynamic decoupling.

Rynaski, E. G.↗

Effect of Foot-and-Mouth Disease Virus 2B Viroporin on Expression and Extraction of Mammalian Cell Culture Produced Foot-and-Mouth Disease Virus-like Particles

To improve the production of foot-and-mouth disease (FMD) molecular vaccines, we sought to understand the effects of the FMD virus (FMDV) 2B viroporin in an experimental, plasmid-based, virus-like particle (VLP) vaccine. Inclusion of the FMDV viroporin 2B into the human Adenovirus 5 vectored FMD vaccine enhanced transgene expression despite independent 2B expression negatively affecting cell viability. Evaluating both wildtype 2B and mutants with disrupted viroporin activity, we confirmed that viroporin activity is detrimental to overall transgene expression when expressed independently. However, the incorporation of 2B into an FMD molecular vaccine construct containing a wildtype FMDV 3C protease, a viral encoded protease responsible for processing structural proteins, resulted in enhancement of transgene expression, validating previous observations. This benefit to transgene expression was negated when using the FMDV 3CL127P mutant, which has reduced processing of host cellular proteins, a reversion resulting from 2B viroporin activity. Inclusion of 2B into VLP production constructs also adversely impacted antigen extraction, a possible side effect of 2B-dependent rearrangement of cellular membranes. These results demonstrate that inclusion of 2B enhanced transgene expression when a wildtype 3C protease is present but was detrimental to transgene expression with the 3CL127P mutant. This has implications for future molecular FMD vaccine constructs, which may utilize mutant FMDV 3C proteases.

2B↗

Mechanical properties and fiber type composition of chronically inactive muscles

A role for neuromuscular activity in the maintenance of skeletal muscle properties has been well established. However, the role of activity-independent factors is more difficult to evaluate. We have used the spinal cord isolation model to study the effects of chronic inactivity on the mechanical properties of the hindlimb musculature in cats and rats. This model maintains the connectivity between the motoneurons and the muscle fibers they innervate, but the muscle unit is electrically "silent". Consequently, the measured muscle properties are activity-independent and thus the advantage of using this model is that it provides a baseline level (zero activity) from which regulatory factors that affect muscle cell homeostasis can be defined. In the present paper, we will present a brief review of our findings using the spinal cord isolation model related to muscle mechanical and fiber type properties.

Non-NASA Center↗

Modeling PAH Mixture Interactions in a Human In Vitro Organotypic Respiratory Model

One of the most significant challenges in human health risk assessment is to evaluate hazards from exposure to environmental chemical mixtures. Polycyclic aromatic hydrocarbons (PAHs) are a class of ubiquitous contaminants typically found as mixtures in gaseous and particulate phases in ambient air pollution associated with petrochemicals from Superfund sites and the burning of fossil fuels. However, little is understood about how PAHs in mixtures contribute to toxicity in lung cells. To investigate mixture interactions and component additivity from environmentally relevant PAHs, two synthetic mixtures were created from PAHs identified in passive air samplers at a legacy creosote site impacted by wildfires. The primary human bronchial epithelial cells differentiated at the air–liquid interface were treated with PAH mixtures at environmentally relevant proportions and evaluated for the differential expression of transcriptional biomarkers related to xenobiotic metabolism, oxidative stress response, barrier integrity, and DNA damage response. Component additivity was evaluated across all endpoints using two independent action (IA) models with and without the scaling of components by toxic equivalence factors. Both IA models exhibited trends that were unlike the observed mixture response and generally underestimated the toxicity across dose suggesting the potential for non-additive interactions of components. Overall, this study provides an example of the usefulness of mixture toxicity assessment with the currently available methods while demonstrating the need for more complex yet interpretable mixture response evaluation methods for environmental samples.

3D in vitro models↗

Stirred-Reactor Coupon Analysis: An International Round Robin Study

The objective of this task was to determine the precision of the SRCA technique when used to determine the dilute condition corrosion rate. To this end, an interlaboratory round robin study was conducted per the instructions in ASTM Practice E691 to measure the precision with which the SRCA test method can be conducted. Twelve independent labs from eleven different institutions each evaluated four glass compositions in three different conditions. The ASTM procedures recommend at least 6 labs participate in a round robin testing the same 3 materials in the same conditions to determine precision. In this case, 12 labs each performed 12 independent tests. This was only possible thanks to the multi-glass testing capability of the SRCA test. A total of 108 duplicate pairs were used to calculate the repeatability of the tests, with the same glass tested in the same vessel, producing as identical conditions as possible for the replicates. These test results were quite tightly clustered, with a median difference from the average value of the pair of only 2.9%. Based on the calculations outlined in ASTM E177-20 and a measured standard deviation of 4.74%, the intralaboratory repeatability limit (r) was calculated to be within 13.3% of the expected value with 95% confidence level. The reproducibility limit (R) of the test was examined using all 277 data points from the round robin. Because of the differences in dissolution rates due to pH variability and intrinsically for the 12 conditions tested, the reproducibility limits for each condition and overall were calculated from the percent relative residual value for each test. The SRCA test is expected to be reproducible within 64% of the expected value with a 95% confidence level.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

H2@Scale Program Multi-Party Cooperative Research and Development Agreement: California Hydrogen Infrastructure Research Consortium Task (Cooperative Research and Development Final Report, CRADA Number CRD-18-00754)

Many stakeholders are working on hydrogen and fuel cell products, markets, requirements, mandates, and policies. California has been leading the way for hydrogen infrastructure and fuel cell electric vehicle (FCEV) deployment. This leadership has advanced a hydrogen network that is not duplicated anywhere in the United States and is unique in the world for its focus on providing a retail fueling experience. In addition, the advancements have identified many lessons learned for hydrogen infrastructure development, deployment, and operation. Other interested states and countries are using California's experience as a model case, making success in California paramount to enabling market acceleration and uptake in the United States. The technical research capability of the national laboratories can be used to assist California in decisions and evaluations, as well as to verify solutions to problems impacting the industry. Because these challenges cannot be addressed by one agency or one laboratory, a hydrogen research consortium has been organized to combine and collaborate. The collaboration aims to ensure that data are available to evaluate projects and inform decision makers, independently verify and validate component solutions, provide experimental results for future hydrogen infrastructure, increase the availability of technical experts for quick-need issues for California hydrogen infrastructure development, deployment, operation, and technology advances. The proposed tasks include data collection from operational stations, component failure fix verification (i.e. nozzle freeze lock), new fueling methods for medium and heavy duty applications, and ensuring hydrogen quality is maintained. U.S. leadership for hydrogen technologies is rooted in California, a location for implementing many H2@Scale pathways such as reducing curtailment and stranded resources, reducing petroleum use and emissions, and developing and creating jobs.

08 HYDROGEN↗

Thermal Scattering Law Evaluations and Progress at NCSU [Slides]

The presentation discusses the eight new Thermal Scattering Law (TSL) evaluations that have been submitted to the National Nuclear Data Center (NNDC). It explains that evaluations are performed using the NCSU FLASSH code and that NJOY/LEAPR input files are provided to allow for independent testing. The presentation concludes by stating that more evaluations are expected to be submitted before the end of 2020.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Technical Report on Waveform Fit Metrics for Global Models

The new WAVEFORMS Initiative in the Ground-based Nuclear Detonation Detection (GNDD) program includes an increased emphasis on the development of Earth models and methods to predict entire seismic and acoustic waveforms more accurately. In general, this increased emphasis is predicated on the need to better characterize seismic events and provide improved model-based discrimination between event types including earthquakes and explosions. More specifically, while current moment tensor inversion methods tend to work well for larger events (M>~4) using tuned 1-D Earth models, the development of state-of-the-art 3-D models and methods is required for the prediction of shorter period waves over large areas for discrimination of smaller events. There is no standard metric for model-based waveform prediction accuracy used in the waveform modeling/inversion community. However, there are several popular waveform misfit definitions; and minimizing the corresponding objective functions is the goal of waveform inversion. Some example misfit definitions employed for adjoint waveform tomography include measures of simple travel time differences (e.g. Tape et al., 2010), cross-correlation travel time differences (e.g. Luo and Schuster, 1991), multi-taper frequency dependent methods (e.g. Lei et al., 2020), time-frequency phase misfit functions (e.g. Fichtner 2010; Rodgers et al., 2022), normalized cross-correlation methods (e.g. Tao et al., 2018), and others. In some cases, these misfit definitions also involve complicated weighting schemes and summations over multiple frequency bands making it difficult to duplicate the misfit measurement with alternative models and datasets. Although each of the misfit definitions mentioned above are useful for developing waveform models, the actual misfit values are not usually meaningful outside of a given project, model, and/or dataset. Therefore, it is difficult to understand and communicate model performance for predicting waveforms and comparing to other models and/or new model iterations with a different dataset. Therefore, there is a need for a generalized method for evaluating overall model performance that is independent from the specific misfit chosen to develop the waveform models that is also intuitive and meaningful. In this report, we describe a new metric we refer to as ‘Percent of Correlated Signal’. The following sections describe and demonstrate the metric with a case study event and a more rigorous test using a random selection of globally distributed events. While the focus here is on global tomography models, the metric is meant to applicable to regional ‘wiggle-for-wiggle’ waveform models/studies as well.

58 GEOSCIENCES↗