SEARCH · Engineering Papers

Results for “Functional data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Deployable sensor system using mesh networking and satellite communication

A sensor system may be configured for continuous operation in a low resource environment and/or in extreme environmental conditions. The sensor system may have sufficient processing capabilities to provide scientific computing for pre-processing, quality control, statistical analysis, event classification, data compression and corrections (e.g., spikes in the data), autonomous decisions and actions, triggering other nodes, and information assurance functions that provide data confidentiality, data integrity, authentication, and non-repudiation. The hardware may have both mesh networking and satellite and cellular communication capability, and may be available for relatively low cost. Such a network provides the flexibility to have potentially any number of nodes be completely independent from one another. Thus, the network may scale across a diverse terrain.

Frigo, Janette↗

DOE OSTI2025

Study of light-meson resonances decaying to K S 0 K π in the B → ( K S 0 K π ) K channels

A study is presented of B + → K S 0 K − π + K + and B + → K S 0 K + π − K + decays based on the analysis of proton-proton collision data collected with the LHCb detector at center-of-mass energies of 7, 8 and 13 TeV, corresponding to an integrated luminosity of 9 fb − 1 . The K S 0 K π invariant-mass distributions of both B + decay modes show, in the m ( K S 0 K π ) < 1.85 GeV mass region, large activity which is resolved using an amplitude analysis. A simple model, where J P C amplitudes are described by multiple Breit-Wigner functions with appropriate angular distributions, provides a good description of the experimental data. In this approach a complex mixture of J P C = 0 − + , 1 + + and 1 + − amplitudes is observed that is dominated by η ( 1405 ) , η ( 1470 ) , η ( 1760 ) , f 1 ( 1285 ) , f 1 ( 1420 ) and h 1 ( 1405 ) resonances. The K S 0 K π Dalitz plots are dominated by asymmetric crossing K * K ¯ bands which are different for the two B + decay modes. This is due to a different interference pattern between the 1 + + and 1 + − amplitudes in the two channels. Branching fractions are measured for each resonant contribution. © 2025 CERN, for the LHCb Collaboration 2025 CERN

Aaij, R. (ORCID:0000000305331952)↗

NASA NTRSDate not supplied

Py MILab: Capturing, Analyzing and Storing Test Data

Integrated Computational Materials Engineering (ICME) has recently received widespread attention due to its promises in reducing dependence on physical testing for engineering design by relying on simulation, reducing both time and cost to market for various applications. ICME however requires validated multiscale material models, which is heavily dependent on available test data with full material and test pedigree, including material processing, test and measurement equipment, raw data collection, and analysis methodology and results. Populating searchable information management systems with such rich data sets is often burdensome for data producers, resulting in a lack of findable data for modelers to validate and verify their models. To overcome these cultural barriers to ICME, NASA has developed of various database-integration toolsets that perform both data management activities within the organization’s best practices with additional functionality that relieves the effort of the data producer and promotes adoption of information management system. One such tool currently under development is Py MILab, an automatic framework for automatic capturing, analysis, maintenance, and storage of material test data. Py MILab uses a modular approach for capturing raw data, analyzing the data, and storing the data in a database, interfaced by neutral file structures, to promote plug-and-play capabilities for various analysis types. TMAnalysis is a Python-based tool that performs automatic data reduction and analysis of uniaxial thermomechanical test data. The TMAnalysis toolset can be implemented within the Analysis module of Py MILab, and thus requires a populated neutral file form the Raw Data Module of Py MILab and outputs a Analysis neutral file compatible with the Database Module of Py MILab. TMAnalysis is able to perform automatic segmentation of multistage tests and perform data analysis and reduction, including determination of point-wise properties in tension, compression, and shear, analysis of stress relaxation tests, creep analysis and zone identification, and combination of these stage types for tests with complex loading histories. The TMAnalysis code is accompanied with a graphical user interface (GUI) that allows users to easily analyze test data in bulk, verify the automatic, consistent analysis performed by the backend code, and edit stage segmentation if necessary before producing the output neutral files, ensuring data is properly analyzed and maintained with full traceability.

Data management↗

DOE OSTI2023

Workflow for High-throughput Screening of Enzyme Mutant Libraries Using Matrix-assisted Laser Desorption/Ionization Mass Spectrometry Analysis of Escherichia coli Colonies

High-throughput molecular screening of microbial colonies and DNA libraries are critical procedures that enable applications such as directed evolution, functional genomics, microbial identification, and creation of engineered microbial strains to produce high-value molecules. A promising chemical screening approach is the measurement of products directly from microbial colonies via optically guided matrix-assisted laser desorption/ionization mass spectrometry (MALDI-MS). Measuring the compounds from microbial colonies bypasses liquid culture with a screen that takes approximately 5 s per sample. We describe a protocol combining a dedicated informatics pipeline and sample preparation method that can prepare up to 3,000 colonies in under 3 h. The screening protocol starts from colonies grown on Petri dishes and then transferred onto MALDI plates via imprinting. The target plate with the colonies is imaged by a flatbed scanner and the colonies are located via custom software. The target plate is coated with MALDI matrix, MALDI-MS analyzes the colony locations, and data analysis enables the determination of colonies with the desired biochemical properties. This workflow screens thousands of colonies per day without requiring additional automation. The wide chemical coverage and the high sensitivity of MALDI-MS enable diverse screening projects such as modifying enzymes and functional genomics surveys of gene activation/inhibition libraries.

Choe, Kisurb↗

DOE OSTI2022

BMC Caller: a webtool to identify and analyze bacterial microcompartment types in sequence data

Bacterial microcompartments (BMCs) are protein-based organelles found across the bacterial tree of life. They consist of a shell, made of proteins that oligomerize into hexagonally and pentagonally shaped building blocks, that surrounds enzymes constituting a segment of a metabolic pathway. The proteins of the shell are unique to BMCs. They also provide selective permeability; this selectivity is dictated by the requirements of their cargo enzymes. We have recently surveyed the wealth of different BMC types and their occurrence in all available genome sequence data by analyzing and categorizing their components found in chromosomal loci using HMM (Hidden Markov Model) protein profiles. To make this a “do-it yourself” analysis for the public we have devised a webserver, BMC Caller (https://bmc-caller.prl.msu.edu), that compares user input sequences to our HMM profiles, creates a BMC locus visualization, and defines the functional type of BMC, if known. Shell proteins in the input sequence data are also classified according to our function-agnostic naming system and there are links to similar proteins in our database as well as an external link to a structure prediction website to easily generate structural models of the shell proteins, which facilitates understanding permeability properties of the shell. Additionally, the BMC Caller website contains a wealth of information on previously analyzed BMC loci with links to detailed data for each BMC protein and phylogenetic information on the BMC shell proteins. Our tools greatly facilitate BMC type identification to provide the user information about the associated organism’s metabolism and enable discovery of new BMC types by providing a reference database of all currently known examples.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

Eta Fragmentation Functions Revisited

We revisit the extraction of parton-to-eta meson fragmentation functions at next-to-leading order accuracy in QCD in the light of the recent hadroproduction measurements in proton-proton collisions obtained by the PHENIX, LHCb, and ALICE collaborations. In addition to an increased precision, the data explore complementary rapidity ranges and center-of-mass system energies. The analysis exploits the theoretical scale dependence to ease tensions among the data sets at different energies that are potentially caused by QCD corrections beyond the next-to-leading order. The resulting set of fragmentation functions yields a consistent description of all available data. Estimates of uncertainties are obtained with the Monte Carlo replica method.

FOS: Physical sciences↗

NASA NTRS2000

Fusion of AIRSAR and TM Data for Parameter Classification and Estimation in Dense and Hilly Forests

The expanded remotely sensed data space consisting of coincident radar backscatter and optical reflectance data provides for a more complete description of the Earth surface. This is especially useful where many parameters are needed to describe a certain scene, such as in the presence of dense and complex-structured vegetation or where there is considerable underlying topography. The goal of this paper is to use a combination of radar and optical data to develop a methodology for parameter classification for dense and hilly forests, and further, class-specific parameter estimation. The area to be used in this study is the H. J. Andrews Forest in Oregon, one of the Long-Term Ecological Research (LTER) sites in the US. This area consists of various dense old-growth conifer stands, and contains significant topographic relief. The Andrews forest has been the subject of many ecological studies over several decades, resulting in an abundance of ground measurements. Recently, biomass and leaf-area index (LAI) values for approximately 30 reference stands have also become available which span a large range of those parameters. The remote sensing data types to be used are the C-, L-, and P-band polarimetric radar data from the JPL airborne SAR (AIRSAR), the C-band single-polarization data from the JPL topographic SAR (TOPSAR), and the Thematic Mapper (TM) data from Landsat, all acquired in late April 1998. The total number of useful independent data channels from the AIRSAR is 15 (three frequencies, each with three unique polarizations and amplitude and phase of the like-polarized correlation), from the TOPSAR is 2 (amplitude and phase of the interferometric correlation), and from the TM is 6 (the thermal band is not used). The range pixel spacing of the AIRSAR is 3.3m for C- and L-bands and 6.6m for P-band. The TOPSAR pixel spacing is 10m, and the TM pixel size is 30m. To achieve parameter classification, first a number of parameters are defined which are of interest to ecologists for forest process modeling. These parameters include total biomass, leaf biomass, LAI, and tree height. The remote sensing data from radar and TM are used to formulate a multivariate analysis problem given the ground measurements of the parameters. Each class of each parameter is defined by a probability density function (pdf), the spread of which defines the range of that class. High classification accuracy results from situations in which little overlap occurs between pdfs. Classification results provide the basis for the future work of class-specific parameter estimation using radar and optical data. This work was performed in part by the Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, and in part by the NASA Ames Research Center, Moffett Field, CA, both under contract from the National Aeronautics and Space Administration.

Moghaddam, Mahta↗

DOE OSTI2024

Lambda-PFLOTRAN 1.0: a workflow for incorporating organic matter chemistry informed by ultra high resolution mass spectrometry into biogeochemical modeling

Abstract. Organic matter (OM) composition plays a central role in microbial respiration of dissolved organic matter and subsequent biogeochemical reactions. Here, a direct connection of organic matter chemistry and thermodynamics to reactive transport simulators has been achieved through the newly developed Lambda-PFLOTRAN workflow tool that succinctly incorporates carbon chemistry data generated from Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) into reaction networks to simulate organic matter degradation and the resulting biogeochemistry. Lambda-PFLOTRAN is a Python-based workflow, executed through a Jupyter notebook interface, that digests raw FTICR-MS data, develops a representative reaction network based on substrate-explicit thermodynamic modeling (also termed lambda modeling due to its key thermodynamic parameter λ used therein), and completes a biogeochemical simulation with the open source, reactive flow and transport code PFLOTRAN. The workflow consists of the following five steps: configuration, thermodynamic (lambda) analysis, sensitivity analysis, parameter estimation, and simulation output and visualization. Two test cases are provided to demonstrate the functionality of the Lambda-PFLOTRAN workflow. The first test case uses laboratory incubation data of temporal oxygen depletion to fit lambda parameters (i.e., maximum utilization rate and microbial carrying capacity). A slightly more complex second test case fits multiple lambda formulation and soil organic matter release parameters to temporal greenhouse gas generation measured during a soil incubation. Overall, the Lambda-PFLOTRAN workflow facilitates upscaling by using molecular-scale characterization to inform biogeochemical processes occurring at larger scales.

58 GEOSCIENCES↗

DOE OSTI2025

In Situ Data Analysis Through Physics-informed Tensor Decompositions (LDRD Final Report)

We introduce a new low-dimensional model of high-dimensional numerical simulation data based on low-rank tensor decompositions. Our new model aims to minimize differences between the model data and simulation data as well as functions of the model data and functions of the simulation data. This novel approach to dimensionality reduction of simulation data provides a means of directly incorporating quantities of interests and invariants associated with conservation principles associated with the simulation data into the low-dimensional model, thus enabling more accurate analysis of the simulation without requiring access to the full set of high-dimensional data. Computational results of applying this approach to two standard low-rank tensor decompositions of data arising from simulation of combustion and plasma physics are presented.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Enabling Command-and-Control in Advanced In Situ Workflows

Scientific discovery is progressing towards autonomous science with the combination of scientific instruments, high-performance computing, and artificial intelligence in complex workflows. This evolution introduces new requirements for managing scientific workflows, including feedback loops, near real-time constraints, and the ability to dynamically control workflow execution. In situ workflows that analyze and visualize data as it is generated are well-suited to satisfy stringent time constraints and their iterative nature offers greater opportunities for command-and-control. However, only a few of the many workflow management systems available have been specifically designed to manage in situ workflows and often lack support for automated feedback loops that allow analysis and visualization components to interact with the main scientific data producer. To address this need, we present in this paper how to add command-and-control capabilities to a workflow management system. We identify the functional design requirements of such a command-and-control system, detail its architecture, interface, and core mechanisms, and illustrate how advanced in situ workflows can leverage command-and-control in three use cases: graceful termination with checkpoint, dynamic and adaptive data reduction, and event-triggered analysis.

Mehta, Kshitij [ORNL] (ORCID:0000000297149981)↗

DOE OSTI2020

Stochastic Gradients for Large-Scale Tensor Decomposition

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tensor decomposition is a recently proposed version of tensor decomposition that allows for a variety of loss functions such as Bernoulli loss for binary data or Huber loss for robust estimation. Here, the stochastic gradient is formed from randomly sampled elements of the tensor and is efficient because it can be computed using the sparse matricized-tensor times Khatri--Rao product tensor kernel. For dense tensors, we simply use uniform sampling. For sparse tensors, we propose two types of stratified sampling that give precedence to sampling nonzeros. Numerical results demonstrate the advantages of the proposed approach and its scalability to large-scale problems.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2018

Integration of Information Management System, Workflow and Computational Tools Enabling Multiscale Modeling Within an ICME Paradigm

With the increased emphasis on reducing the cost and time to market of new materials, the need for analytical tools that enable the virtual design and optimization of materials throughout their processing - internal structure - property - performance envelope, along with the capturing and storing of the associated material and model information across its lifecycle, has become critical. This need is also fueled by the demands for higher efficiency in material testing; consistency, quality and traceability of data; product design; engineering analysis; as well as control of access to proprietary or sensitive information. Fortunately, material information management systems and physics-based multiscale modeling methods have kept pace with the growing user demands. Herein, recent efforts to develop a set of Python functions that exchange information between NASA GRC's Integrated multiscale Micromechanics Analysis Code (ImMAC) software toolset and its Integrated Computational Materials Engineering (ICME), Granta MI® database schema is presented. The goal is to enable seamless coupling between both test data and simulation data, which is captured and tracked automatically within Granta MI®, with full model pedigree information. These tools, and this type of linkage, are foundational to realizing the full potential of ICME, in which materials processing, microstructure, properties, and performance are coupled to enable application-driven design and optimization of materials and structures.

multiscale modeling; Micromechanics; Computational↗

DOE OSTI2025

Using Temporal Information from Human Mobility Data to Detect Anchor Points

Spatiotemporal mobility data are available in massive quantities, but large quantities of data typically include fewer variables or data fields. Often, the only available fields are User ID, Longitude, Latitude, Timestamp (ULLT). This raises an important question: how much can we infer about human mobility patterns using only these four fields? With ULLT data, we do not know individuals' socioeconomic status information or when they are visiting their anchor points (AP) or locations (such as homes, places of employment, or schools), and it is a modern challenge to use this data to infer these characteristics. When detecting anchor locations with limited input information, verification and validation (VV) are significant challenges. This paper addresses the problem of identifying individuals' anchor locations using only temporal information from spatiotemporal datasets with limited attributes. Our approach does not explicitly use latitude and longitude during analysis. Locationbased information is only employed in the preprocessing stage to identify periods of movement (trips) and stops (dwelling). Beyond this step, all analysis is based on temporal patterns. In theory, if stops and dwell times could be detected through alternative means, our method could function entirely without location-based input. We demonstrate this methodology on the 2017 National Household Travel Survey (NHTS) data, because it includes a carefully designed and collected time use survey with representative sampling and labeled ground truth. The high-quality survey data allows us to test the accuracy of our methods because NHTS contains intended place labels and agent/user characteristics. We have also applied our validated AP identification algorithm on very large-scale GPS based trajectory data for Patterns-of-Life (PoL) assessment and other applications, but due to space limit that could not be presented here.

McBride, Liz [ORNL] (ORCID:0000000286925869)↗

DOE OSTI2021

Search for CPT and Lorentz invariance violation in the muon $g -2$ experiment at Fermilab

The Muon g-2 experiment at Fermilab (E989) aims to measure the anomalous magnetic moment of the muon, $a_{\mu}= (g-2)/2$, to a groundbreaking precision of $140$ ppb, obtaining a near four-fold increase in precision over the previous experiment, E821, at the Brookhaven National Laboratory (BNL). The value of $a_{\mu}$ from BNL currently differs from the Standard Model prediction by $\sim 3.7$ standard deviations, suggesting the potential for new physics and therefore, motivating a new experiment.Because the theory predicts this number with high precision, testing the g-factor through experiment provides a stringent test of the SM and can suggest physics beyond the Standard Model. The goal of the Fermilab Muon $g-2$ experiment is to increase the statistical precision by more than a factor of 20 and reduce systematic errors by a factor of 3. By measuring muon precession rate ($\omega_a$) in an external magnetic field, the anomalous magnetic moment will be calculated. This is an incredibly challenging experiment with a unique opportunity to provide new insight into nature. \\ The $g-2$ data also provides a great opportunity for setting the most stringent limits on some of the Standard Model Extension CPT Lorentz violating (LV) parameters in the muon sector. One of the CPT and Lorentz violating signatures that we can look for using $g-2$ data is a sidereal variation of $\omega_a(t)$. Extensive simulation studies confirm that the sensitivity regarding the sidereal varation roughly scales with $\omega_a$ uncertainty. Hence, the $g-2$ experiment at FNAL should be able to reach limits of $\sim 5\times10^{-25}$ GeV. Because the CPT and LV analyses are essentially studies of variations in $\omega_a$ as a function of time and charge, performing an $\omega_a$ analysis sets the stage for the CPT and LV measurement. This dissertation focuses on the methodology of a fully functioning framework and analyzing the Fermilab Muon $g - 2$ Run 2 data containing $\sim 11$ billion events above an energy threshold of $1.7$~GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Reliability-Informed Life-Cycle Warranty Cost Analysis: A Case Study on a Transmission in Agricultural Equipment

In agricultural and industrial equipment, both new and remanufactured systems are often available for warranty coverage. In such cases, it may be challenging for equipment manufacturers to properly trade-off between the system reliability and the cost associated with a replacement option (e.g., replace with a new or remanufactured system). To address this problem, we present a reliability-informed life-cycle warranty cost (LCWC) analysis framework that enables equipment manufacturers to evaluate different warranty policies. These warranty policies differ in whether a new or remanufactured system is used for replacement in the case of product failure. The novelty of this LCWC analysis framework lies in its ability to incorporate real-world field reliability data into warranty policy assessment using probabilistic warranty cost models that consider multiple life cycles. First, the reliability functions for the new and remanufactured systems are built as the time-to-failure distributions that provide the best-fit to the field reliability data. Then, these reliability functions and their corresponding warranty policies are used to build the LCWC models according to the specific warranty terms. Finally, Monte Carlo simulation is used to propagate the time-to-failure uncertainty of each system, modeled by its reliability function, through each LCWC model to produce a probability distribution of the LCWC. The effectiveness of the proposed reliability-informed LCWC analysis framework is demonstrated with a real-world case study on a transmission used in some agricultural equipment.

agricultural equipment↗

NASA NTRS1997

Quantitative spectroscopy for the analysis of GOME data

Accurate analysis of the global ozone monitoring experiment (GOME) data to obtain atmospheric constituents requires reliable, traceable spectroscopic parameters for atmospheric absorption and scattering. Results are summarized for research that includes: the re-determination of Rayleigh scattering cross sections and phase functions for the 200 nm to 1000 nm range; the analysis of solar spectra to obtain a high-resolution reference spectrum with excellent absolute vacuum wavelength calibration; Ring effect cross sections and phase functions determined directly from accurate molecular parameters of N2 and O2; O2 A band line intensities and pressure broadening coefficients; and the analysis of absolute accuracies for ultraviolet and visible absorption cross sections of O3 and other trace species measurable by GOME.

Chance, K.↗

NASA NTRS2013

Preliminary Results from the Joint Russian and US Field Test: Measurement of Sensorimotor and Cardiovascular Responses Immediately Following Landing of the Soyuz Spacecraft

Ongoing collaborative research efforts between NASA's Neuroscience and Cardiovascular Laboratories, and the Institute of Biomedical Problems' (IBMP) Sensory-Motor and Countermeasures Laboratories have been measuring functional sensorimotor, cardiovascular and strength responses following bed rest, dry immersion, short duration (Space Shuttle) and long duration (Mir and International Space Station) space flights. While the unloading paradigms associated with dry immersion and bed rest have do serve as acceptable flight analogs, testing of crew responses following the long duration flights does not begin until a minimum of 24 hours after landing. As a result it is not possible to estimate the nonlinear trend of the early (<24 hr) recovery process nor is it possible to accurately assess the full impact of the decrements associated with long duration flight. To overcome these limitations both the Russian and U.S. sides have implemented testing at the time of landing and before the flight crews have left the landing site. By joint agreement this research effort has been identified as the functional Field Test (FT). For practical reasons the FT has been divided into two phases: the full FT and a preliminary pilot version (PFT) of the FT that is reduced in both length and scope. The primary goal of this research is to determine functional abilities in long duration space flight crews beginning as soon after landing as possible (< 2 hr) with one to three immediate follow-up measurements on the day of landing. This goal has both sensorimotor and cardiovascular elements including an evaluation of NASA's new anti-orthostatic compression garment as compared with the Russian Kentavr garment. Functional sensorimotor measurements will include, but are not limited to, assessment of hand/eye coordination, ability to egress from a seated position, walk normally without falling, measurement of dynamic visual acuity, ability to discriminate different forces generated with both the hands and legs, recovery from a fall, a coordinated walk involving tandem heel-to-toe placement and determination of postural ataxia while standing. The cardiovascular portion of the investigation includes blood pressure and heart rate measurements during a timed stand test in conjunction with postural ataxia testing. In addition to the immediate post-landing collection of data for the full FT, postflight data will be acquired at a minimum of one to three more other times within the 24 hr following landing and continue until functional sensorimotor and cardiovascular responses have returned to preflight normative values. The PFT represents a single trial run comprised of jointly agreed tests from the full FT and relies heavily on IBMP's Sensory-Motor and Countermeasures Laboratories for content, and implementation. The PFT is currently scheduled for the September 2013 landing of the Soyuz spacecraft (34S). Testing will include: (1) a sit-to-stand test, (2) recovery from a fall where the crewmember begins in the prone position on the ground and then stands for 3 min while cardiovascular stability is determined and postural ataxia data are acquired, and (3) a tandem heel-to-toe walk to determine changes in the central locomotor program. Video, cardiovascular parameters (heart rate and blood pressure), data from body-worn inertial sensors and severity of postflight motion sickness will be available for analysis. It is our intent to present, at this celebratory symposium, a summary of these data obtained from two crewmembers. In summary, the level of functional deficit is expected to be most profound during the acquisition of gravity loads immediately after landing when the demands for crew intervention in response to emergency operations will be greatest. Clearly measureable performance parameters such as ability to perform a seat egress, recover from a fall or the ability to see clearly when walking, and related physiological data (orthostatic responses) are required to provide an evidence base for characterizing programmatic risks and the degree of variability among crewmembers. Overall, these early functional and related physiological measurements will allow estimation of nonlinear sensorimotor and cardiovascular recovery trends to an accuracy that has not been previously captured in over 50 years of space flight.

Reschke, M. F.↗

NASA NTRS1999

Cloud 3D Effects Evidenced in Landsat Power Spectra and Autocorrelation Functions

An analysis of nadir reflectivity Fourier spatial power spectra and autocorrelation functions at solar wavelengths and for cloudy conditions has been carried out. The data come from Landsat Thematic Mapper (TM) observations, while Monte Carlo (MC) simulations are used to aid the interpretation of the Landsat results. We show that radiative processes produce consistent signatures on power spectra and autocorrelation functions. The former take a variety of forms not shown or explained in previous observational studies. We demonstrate that the TM spectra can potentially be affected by both radiative "roughening" at intermediate scales (approx. 1 -5 km), being more prevalent at large solar zenith angles, and the already documented radiative "smoothing" at small scales (less than 1 km). These processes are wavelength dependent, as shown by systematic differences between conservative (for cloud droplets) TM band 4 (approx. 0.8 microns) and absorbing band 7 (approx. 2.2 microns): band 7 exhibits more roughening and less smoothing. This is confirmed quantitatively by comparing least-squared fitted power spectral slopes for the two bands. It is also corroborated by a slower decrease with distance of autocorrelation function values for band 4 compared to band 7. The appearance of roughening at large solar zenith angles is a result of side illumination and shadowing and adds an additional complexity to the power spectra. MC spectra are useful in illustrating that scale invariant optical depth fields can produce complex power spectra that take a variety of shapes under different conditions. We show that radiative roughening increases with the decrease of single scattering albedo and with the increase of solar zenith angle (as in the observations). For high Sun there is also a clear shift of the radiative smoothing scale to smaller values as droplet absorption increases. The shape of the power spectrum is sensitive to the magnitude and type of cloud top height variability, with the spectral signatures of decorrelation between reflectance and optical depth at large scales becoming stronger as the magnitude of cloud top variations increase. Finally, the usefulness of power spectral analysis in evaluating the skill of novel optical depth retrieval techniques in removing 3D radiative effects is demonstrated. New techniques using inverse Non-local Independent Pixel Approximation (NIPA) and Normalized Difference of Nadir Reflectivity (NDNR) yield optical depth fields which better match the scale-by-scale variability of the true optical depth field.

Oreopoulos, Lazaros↗