Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

In-Situ Process Monitoring, Synchronization, and Mapping Laser Powder Bed Fusion Builds of Ti6Al4V

The use of in-situ process monitoring is of interest to lower the cost of inspection for the qualification of laser powder bed fusion (LPBF) parts. Precise monitoring of the LPBF-AM build process constitutes a multi-scale and multi-discipline task. There are several significant challenges to the in-situ approach: the synchronization of sensor signals to process steps, the physical interpretation and classification of sensor signals, managing very large datasets, and comparing the inputs with the observed monitoring signals. At NASA Langley Research Center, a configurable architecture additive testbed has been developed to monitor the build process with synchronized sensors. The philosophy and method adopted for the synchronization of the cameras with laser power & position Ti-6Al-4V LPBF are described. The synchronized in-situ monitoring signals are compared with ex-situ nondestructive inspection and optical microscopy observations. Such comparisons permit a better understanding of how the sequential process actions of LPBF-AM can affect build quality.

Laser Powder Bed Fusion↗

Continuity of A Global, Satellite-Based Terrestrial Primary Productivity Dataset in the VIIRS Era Achieved With Model-Data Fusion

The NASA Terra and Aqua satellites have been successfully operating for over two decades and have far exceeded their original 5‐year design life. However, the era of NASA’s Earth Observing System (EOS) may be coming to a close as early as 2023. We conducted a comprehensive calibration and validation of the MODIS MOD17 product [1,2] and the potential for continuity of multi‐decadal ecosystem gross primary productivity (GPP) and annual net primary productivity (NPP), using data from the Visible Infrared Imaging Radiometer Suite (VIIRS) sensors aboard Suomi NPP and NOAA‐20. We combined an 18‐year record of eddy covariance flux tower measurements with hundreds of field measurements of NPP from the Oak Ridge National Laboratories Multi‐Biome collection to benchmark MODIS MOD17 Collection 6.1 (C61) and to develop the first terrestrial productivity estimates from VIIRS. Plant traits from the literature and the global TRY database [3,4] provide strong priors for identifying model parameters in a Bayesian model‐data fusion. As MODIS‐like observations are still needed for global environmental applications, the new VIIRS VNP17 product has the potential to extend these continuous estimates of global, terrestrial primary productivity beyond 2030.

K. Arthur Endsley↗

PACE: How One NASA Mission Aligns With the United Nations Decade of Ocean Science for Sustainable Development (Ocean Shot #1)

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE; https://pace.gsfc.nasa.gov) mission, scheduled for launch in January 2024, will extend the continuous high-quality ocean color, atmospheric aerosol, and cloud data records begun by NASA in the late 1990s, building on the heritage of the Coastal Zone Color Scanner (CZCS), Sea-viewing Wide Field-of-view Sensor (SeaWiFS), Moderate Resolution Imaging Spectroradiometer (MODIS), and Visible Infrared Imaging Radiometer Suite (VIIRS) (Figure 1). PACE’s global hyperspectral imaging radiometer design concept will enable new discoveries in Earth’s living ocean (Figure 2), such as the diversity of organisms fueling marine food webs and how aquatic ecosystems respond to environmental change. Its instrument payload (Figure 3) will also observe Earth’s atmosphere to study clouds, airborne aerosol particles, and the interactions between the two. Looking at the ocean, clouds, and aerosols together will improve our knowledge of the roles each plays in our evolving planet. Other applications of PACE science data records—from identifying the frequency, extent, and duration of aquatic harmful algal blooms to improving our understanding of air quality—will result in direct economic, recreational, and societal benefits. Ultimately, by extending and expanding NASA’s long record of global Earth satellite observations, the PACE mission will monitor our home planet in new and advanced ways in the coming decade.

Ocean color↗

CPF-VIIRS Intercalibration Methodology

NASA’s Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder (CPF) mission will carry a high-accuracy reflected solar (RS) spectrometer to measure the Earth-reflected solar radiation from International Space Station with an SI-traceable radiometric uncertainty of 0.3% (1-sigma). The CPF measurements will serve as an on-orbit reference for intercalibrating other spaceflight RS instruments. The CPF intercalibration team has developed a state-of-the-art approach to calibrate the reflective solar bands (RSB) of the NOAA-20 Visible Infrared Imaging Radiometer Suite (VIIRS) sensor against the CPF benchmark measurements with an aimed intercalibration methodology uncertainty of 0.3%. This presentation will highlight the CPF mission overview and CPF-VIIRS intercalibration approach, as well as other potential outcomes of the CPF-VIIRS intercalibration study that may benefit the broader remote sensing community.

Raj Bhatt↗

Modeling and Performance Analysis of the LUVOIR Coronagraph Instrument

Future space missions such as the Large UV/Optical/Infrared Surveyor (LUVOIR) and the Habitable Exoplanet Observatory, when equipped with coronagraphs with active wavefront control to suppress starlight, will allow the discovery and characterization of habitable exoplanets. The Extreme Coronagraph for Living Planetary Systems (ECLIPS) is the coronagraph instrument on the LUVOIR Surveyor mission concept, an 8- to 15-m segmented telescope. ECLIPS is split into three channels, namely, UV (200 to 400 nm), optical (400 to 850 nm), and near IR (850 nm to 2 μm), with each channel equipped with two deformable mirrors for wavefront control, a suite of coronagraph masks, a low-order/out-of-band wavefront sensor, and separate science imagers and spectrographs. The apodized pupil Lyot coronagraph and the vector vortex coronagraph are the baselined mask technologies for ECLIPS to enable the required 10−10 contrast for observations in the habitable zones of nearby stars for LUVOIR-A (15-m telescope) and LUVOIR-B (8-m telescope), respectively. Their performance depends on active wavefront sensing and control, as well as metrology subsystems to compensate for aberrations induced by segment errors (e.g., piston and tip/tilt), secondary mirror misalignment, and global low-order wavefront errors. Here, we present the latest results of the simulation of these effects for the LUVOIR coronagraph instrument and discuss the achieved contrast for exoplanet detection and characterization after closed-loop wavefront estimation and control algorithms have been applied. Finally, we show simulated observations using high-fidelity spatial and spectral input models of complete planetary systems generated with the Haystacks code framework.

Roser Juanola-Parramon↗

Powder Bed Fusion Laser Beam Metals Additive Manufacturing: Process Monitoring Approaches for Qualification and Certification

The use of in-situ process monitoring is of interest to lower the cost of inspection for the qualification of powder bed fusion laser beam metal (PBF-LB/M) additively manufactured (AM) parts. Precise monitoring of the PBF-LB/M AM build process constitutes a multi-scale and multi-discipline task. There are several significant challenges to the in-situ approach: the synchronization of sensor signals to process steps; the physical interpretation and classification of sensor signals; managing very large datasets; and comparing the inputs with the observed monitoring signals. At NASA Langley Research Center, a configurable architecture additive testbed has been developed to monitor the build process with synchronized sensors. The philosophy and method adopted for the synchronization of the cameras with laser power and position throughout a complex PBF-LB/M AM build will be described. The synchronized in-situ monitoring signals are compared with ex-situ nondestructive inspection, x-ray computed tomography (XCT). Such comparisons permit a better understanding of how the sequential process actions of LPBF-AM can affect build quality. The multi-scale and complex process of printing additively manufactured (AM) parts can have unexpected, but predictable, build conditions that result in material microstructure variability. This presentation will describe an additive manufacturing model-based process metric (AM-PM) computational method that is a fully parallel reduced order modeling approach developed to evaluate the evolution of AM processes. This method couples the known sequence of the AM process with a physically informed nearest neighbors’ calculation to map the conditions of a part-scale build. The result is a map of the build that is derived directly from build files or in-situ process monitoring sensors. The methodology of the approach will be described and mapped to the porosity observed from XCT for a complex PBF-LB/M build. Such comparative results develop understanding of how the sequential process actions can affect the PBF-LB/M AM build quality and microstructure variability.

Laser Powder Bed Fusion↗

Physiological and Subjective Responses of Pilots during Advanced Air Mobility Flight Testing with Automated Systems

Aviation is constantly evolving, mostly due to the integration of automated systems into the National Airspace System. This presents a host of challenges and opportunities. NASA’s Advanced Air Mobility (AAM) project has taken a significant leap forward with a research flight test led by the Integration of Automated Systems (IAS) sub-project. This effort focused on assessing automated flight deck algorithms essential for supporting high-density Urban Air Mobility (UAM) operations. Carrying out a two-ship flight test in UAM Maturity Level 4 scenarios, the team evaluated state-of-the-art algorithms, including Hazard Perception and Avoidance (HPA) and flight path management (FPM) systems. This paper investigates into pilots’ physiological and subjective responses during the flight scenarios conducted. In collaboration with Lockheed Martin Advanced Technology Laboratories (ATL), we collected and analyzed live-flight biometric data using eye tracking, mobile brain imaging, and heart rate sensors. The study provides insights into pilots’ workload and cognitive engagement while navigating automated tools, leveraging both biometric data and post-encounter subjective assessments. The research highlights the interaction between human operators and automated systems, contributing valuable lessons learned about gathering human data in live-flight environments. The knowledge acquired from this study enhances our understanding of human factors in automated flight and informs future studies attempting to undertake similar feats.

Kevin J. Monk↗

Physiological and Subjective Responses of Pilots During Advanced Air Mobility Flight Testing With Automated Systems

Aviation is constantly evolving, mostly due to the integration of automated systems into the National Airspace System. This presents a host of challenges and opportunities. NASA's Advanced Air Mobility (AAM) project has taken a significant leap forward with a research flight test led by the Integration of Automated Systems (IAS) sub-project. This effort focused on assessing automated flight deck algorithms essential for supporting high-density Urban Air Mobility (UAM) operations. Carrying out a two-ship flight test in UAM Maturity Level 4 scenarios, the team evaluated state-of-the-art algorithms, including Hazard Perception and Avoidance (HPA) and flight path management (FPM) systems. This presentation focuses on results of pilots' physiological and subjective responses during the flight scenarios conducted. In collaboration with Lockheed Martin Advanced Technology Laboratories (ATL), we collected and analyzed live-flight biometric data using eye tracking, mobile brain imaging, and heart rate sensors. The data provides insights into pilots' workload and cognitive engagement while navigating automated tools, leveraging both biometric data and post-encounter subjective assessments. The research highlights the interaction between human operators and automated systems, contributing valuable lessons learned about gathering human data in live-flight environments. The knowledge acquired from this endeavor enhances our understanding of human factors in automated flight and informs future studies attempting to undertake similar feats.

air mobility↗

Asheville Urban Development II: Mapping Urban Heat to Support Cooling Initiatives and Climate Resilience Planning in the Greater Asheville Area

Asheville, North Carolina experiences the urban heat island effect, where temperatures in the city are higher than in surrounding rural areas. This effect intensifies with increased urbanization and less vegetative cover. Asheville’s urban heat island was exacerbated by population increases and tree cover decline, escalating the need for heat mitigation. We partnered with the City of Asheville’s Sustainability Department and Asheville GreenWorks whose actions prioritize sustainable city planning and equitable climate resilience. Using NASA Earth observations and ancillary datasets we spatially mapped urban heat, heat vulnerability, and cooling and adaptive capacity from 2019-2023. To map urban heat, we used Landsat 8 and 9 Operational Land Imager and Thermal Infrared Sensor for land surface temperature and albedo data and the ECOsystem Spaceborne Thermal Radiometer Experiment on Space Station for evapotranspiration data. We assessed heat vulnerability using the urban heat data andthe Centers for Disease Control and Prevention’s Social Vulnerability Index. To evaluate cooling and adaptive capacity we used the InVEST Urban Cooling Model, integrating our heat vulnerability analysis with land use and cover data from Sentinel-1 Synthetic Aperture Rada rand Sentinel-2 Multispectral Instrument. Our results revealed distinct spatial patterns of urban heat, heat vulnerability, and cooling and adaptive capacity in Asheville with downtown as the focal hotspot and an outward decreasing radial pattern. These findings highlight targeted need for interventions to reduce heat impacts, address environmental injustices, and enhance climate resilience. Our project provided research to local organizations that can be used for heat mitigation in the greater Asheville area.

Authors not in NED but are confirmed contractors. ↗

Imaging stress and magnetism at high pressures using a nanoscale quantum sensor

Pressure alters the physical, chemical, and electronic properties of matter. The diamond anvil cell enables tabletop experiments to investigate a diverse landscape of high-pressure phenomena. In this work, we introduce and use a nanoscale sensing platform that integrates nitrogen-vacancy (NV) color centers directly into the culet of diamond anvils. We demonstrate the versatility of this platform by performing diffraction-limited imaging of both stress fields and magnetism as a function of pressure and temperature. We quantify all normal and shear stress components and demonstrate vector magnetic field imaging, enabling measurement of the pressure-driven α ↔ ϵ phase transition in iron and the complex pressure-temperature phase diagram of gadolinium. A complementary NV-sensing modality using noise spectroscopy enables the characterization of phase transitions even in the absence of static magnetic signatures.

36 MATERIALS SCIENCE↗

Virtual Sensing with Unsupervised Image-to-Image Translation

Earth observing satellites carrying multi-spectral sensors are widely used to monitor the physical and biological states of the atmosphere, land, and oceans. These satellites have different vantage points above the earth and different spectral imaging bands resulting in inconsistent imagery from one to another. This presents challenges in building downstream applications. What if we could generate synthetic bands for existing satellites from the union of all domains? We tackle the problem of generating synthetic spectral imagery for multispectral sensors as an unsupervised image-to-image translation problem with partial labels and introduce a novel shared spectral reconstruction loss. Simulated experiments performed by dropping one or more spectral bands show that cross-domain reconstruction outperforms measurements obtained from a second vantage point. On a downstream cloud detection task, we show that generating synthetic bands with our model improves segmentation performance beyond our baseline. Our proposed approach enables synchronization of multispectral data and provides a basis for more homogeneous remote sensing datasets.

Geostationary satellites↗

Multi-Sensor Registration of Earth Remotely Sensed Imagery

Assuming that approximate registration is given within a few pixels by a systematic correction system, we develop automatic image registration methods for multi-sensor data with the goal of achieving sub-pixel accuracy. Automatic image registration is usually defined by three steps; feature extraction, feature matching, and data resampling or fusion. Our previous work focused on image correlation methods based on the use of different features. In this paper, we study different feature matching techniques and present five algorithms where the features are either original gray levels or wavelet-like features, and the feature matching is based on gradient descent optimization, statistical robust matching, and mutual information. These algorithms are tested and compared on several multi-sensor datasets covering one of the EOS Core Sites, the Konza Prairie in Kansas, from four different sensors: IKONOS (4m), Landsat-7/ETM+ (30m), MODIS (500m), and SeaWIFS (1000m).

LeMoigne, Jacqueline↗

Active Optical Control with Machine Learning: A Proof of Concept for the Vera C. Rubin Observatory

Abstract The Active Optics System of the Vera C. Rubin Observatory (Rubin) uses information provided by four wave front sensors to determine deviations between the reconstructed wave front and the ideal wave front. The observed deviations are used to adjust the control parameters of the optical system to maintain image quality across the 3.°5 field of view. The baseline approach from the project is to obtain amplitudes of the Zernike polynomials describing the distorted wave front from out-of-focus images collected by the wave front sensors. These Zernike amplitudes are related via an “influence matrix” to the control parameters necessary to correct the wave front. In this paper, we use deep-learning methods to extract the control parameters directly from the images captured by the wave front sensors. Our neural net model uses anti-aliasing pooling to boost performance, and a domain-specific loss function to aid learning and generalization. The accuracy of the control parameters derived from our model exceeds Rubin requirements even in the presence of full-moon background levels and mis-centering of reference stars. Although the training process is time consuming, model evaluation requires only a few milliseconds. This low latency should allow for the correction of the optical configuration during the readout and slew interval between successive exposures.

Astronomy & Astrophysics↗

Wind dynamic range video camera

A television camera apparatus is disclosed in which bright objects are attenuated to fit within the dynamic range of the system, while dim objects are not. The apparatus receives linearly polarized light from an object scene, the light being passed by a beam splitter and focused on the output plane of a liquid crystal light valve. The light valve is oriented such that, with no excitation from the cathode ray tube, all light is rotated 90 deg and focused on the input plane of the video sensor. The light is then converted to an electrical signal, which is amplified and used to excite the CRT. The resulting image is collected and focused by a lens onto the light valve which rotates the polarization vector of the light to an extent proportional to the light intensity from the CRT. The overall effect is to selectively attenuate the image pattern focused on the sensor.

Craig, G. D.↗

Assessment of High Resolution Commercial Satellite Geolocation Accuracy

Commercial companies such as Maxar, PlanetScope, and BlackSky have launched many satellites with revisit times ranging from two hours to one day and have built large archives of high resolution (1-3 m) Earth observing data. The high temporal resolution and global coverage of these satellites makes commercial satellite images ideal for scientists studying rapidly changing processes such as flooding and fires. A key step in assessing changes in these images is co-registration of various images to each other. High geolocation accuracy (at most 0.5 pixels of offset) allows for easy co-registration of images across different times and sensors. Here, we assess the latest PlanetScope imagery and evaluate it for geolocation accuracy. For our assessment, we compare the target image to a reference image with known geolocation accuracy (WorldView imagery) and determine the offset between these images by shifting them to maximize their Pearson Cross-Correlation (PCC) value. Offsets required to maximize the PCC give the geolocation accuracy of the target image relative to the reference image. Previously, our global assessment of Planet data revealed large variability in geolocation accuracy from one continent to another. The measured root mean squared errors (RMSEs) range from 5.4 m in North America to 14.9 m in Africa. We have updated this previous assessment to include both their newest SuperDove series as well as a more robust assessment of the temporal stability of PlanetScope's geolocation accuracy.

Alana G. Semple↗

Boundary-Aware Adversarial Learning Domain Adaption and Active Learning for Cross-Sensor Building Extraction

The use of convolutional neural networks (CNNs) for building extraction from remote sensing images has been widely studied and many public datasets have been made available for accelerating development of these CNN models. Yet adapting pretrained models at scale in real-world scenarios remains a challenging task. The main barrier is that certain new labels are still needed to compensate for domain shifting between the labeled data and new images that potentially cover new geographic locations or that are from a different sensor. In this article, we propose to add informatively labeled samples from a new image pool under the paradigm of active learning. To select the most useful samples based on model uncertainty, we first tackle the problem of uncalibrated uncertainty estimation due to distribution shifting by adapting feature extractors with boundary-based adversarial learning. Calibrated uncertainty is used as the query criterion in the active learning process, where the most uncertain samples are selected for annotation and included for model retraining. The proposed workflow was tested with three data pairs in which each workflow represents a scenario often encountered in real-world applications, including adapting pretrained models to new images collected with different sensors or to new geographic areas where appearances and types of buildings are very different. Compared to several baselines, including random sampling, temperature scaling (a well-known uncertainty calibration technique), different query strategies, and active domain adaptation methods, the proposed workflow shows that strategically querying a smaller set of samples for labeling achieves comparable or better building extraction performance. The proposed method reduces the number of labeled samples required to achieve sufficient model accuracy, thus significantly reducing hundreds of person-hours for labeled data creation. In addition, we include a few considerations when deploying this workflow in a GPU cluster that can be easily adapted to achieve operational building extraction model retraining.

97 MATHEMATICS AND COMPUTING↗

Stratospheric temperature measurements from nanosatellite stellar occultation observations of refractive bending

Abstract. Stellar occultation observations from space can probe the stratosphere and mesosphere at a fine vertical scale around the globe. Unlike other measurement techniques like radiosondes and aircraft, stellar occultation has the potential to observe the atmosphere above 30 km, and unlike radio occultation, stellar occultation probes fine-scale phenomena with potential to observe atmospheric turbulence. We imaged the refractive bending angle of a star centroid for a series of occultations by the atmosphere. Atmospheric refractivity, density, and then temperature are retrieved from the bending observations with the Abel transformation and Edlén's law, the hydrostatic equation, and the ideal gas law. The retrieval technique is applied to data collected by two nanosatellites operated by Terran Orbital. Measurements were primarily taken by the GEOStare SV2 mission, with a dedicated imaging telescope, supplemented with images captured by spacecraft bus sensors, namely the star trackers on other Terran Orbital missions. The bending angle noise floor is 10 and 30 arcsec for the star tracker and GEOStare SV2 data, respectively. The most significant sources of uncertainty are due to centroiding errors due to the fairly low-resolution stellar images and telescope pointing knowledge derived from noisy satellite attitude sensors. The former mainly affects the star tracker data, while the latter limits the GEOStare SV2 accuracy, with both providing low vertical resolution. This translates to a temperature profile retrieval up to roughly 20 km for both star tracker and GEOStare SV2 datasets. In preparation of an upcoming 2023 mission designed to correct these deficiencies, SOHIP, we simulated bending angle measurements with varying magnitudes of error. The expected maximum altitude of retrieved temperature is 41 km on average for these simulated measurements with a noise floor of 0.39 arcsec. Our work highlights the capabilities of stellar occultation observations from nanosatellites for atmospheric sounding. Future work will investigate high-frequency observations of atmospheric gravity waves and turbulence, mitigating the major uncertainties observed in these datasets.

54 ENVIRONMENTAL SCIENCES↗