Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

High-precision chemical quantum sensing in flowing monodisperse microdroplets

A method is presented for high-precision chemical detection that integrates quantum sensing with droplet microfluidics. Using nanodiamonds (ND) with fluorescent nitrogen-vacancy (NV) centers as quantum sensors, rapidly flowing microdroplets containing analyte molecules are analyzed. A noise-suppressed mode of optically detected magnetic resonance is enabled by pairing controllable flow with microwave control of NV electronic spins, to detect analyte-induced signals of a few hundredths of a percent of the ND fluorescence. Using this method, paramagnetic ions in droplets are detected with low limit-of-detection using small analyte volumes, with exceptional measurement stability over >10 3 s. In addition, these droplets are used as microconfinement chambers by co-encapsulating ND quantum sensors with various analytes such as single cells, suggesting wide-ranging applications including single-cell metabolomics and real-time intracellular measurements from bioreactors. Important advances are enabled by this work, including portable chemical testing devices, amplification-free chemical assays, and chemical imaging tools for probing reactions within microenvironments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Final Report DE-SC0020773

The DOE/NNSA sought development of innovative portable neutron/x-ray cameras for imaging and, when coupled with a portable source, also for radiography. This project focused on developing such a device that promises to have excellent resolution, while also providing neutron/gamma separation. We developed an Application Specific Integrated Circuit (ASIC) to be employed in conjunction with existing sensor technologies and modern assembly techniques. The concepts developed were a combination of new novel techniques and an innovative implementation of existing methods boosted by technological advances in ASIC performance.

61 RADIATION PROTECTION AND DOSIMETRY↗

Early Detection of Drought Stress in Durum Wheat Using Hyperspectral Imaging and Photosystem Sensing

Wheat, being the third largest U.S. crop and the principal food grain, faces significant risks from climate extremes such as drought. This necessitates identifying and developing methods for early water-stress detection to prevent yield loss and improve water-use efficiency. This study investigates the potential of hyperspectral imaging to detect the early stages of drought stress in wheat. The goal is to utilize this technology as a tool for screening and selecting drought-tolerant wheat genotypes in breeding programs. Additionally, this research aims to systematically evaluate the effectiveness of various existing sensors and methods for detecting early stages of water stress. The experiment was conducted in a durum wheat experimental field trial in Maricopa, Arizona, in the spring of 2019 and included well-watered and water-limited treatments of a panel of 224 replicated durum wheat genotypes. Spectral indices derived from hyperspectral imagery were compared against other plant-level indicators of water stress such as Photosystem II (PSII) and relative water content (RWC) data derived from proximal sensors. Our findings showed a 12% drop in photosynthetic activity in the most affected genotypes when compared to the least affected. The Leaf Water Vegetation Index 1 (LWVI1) highlighted differences between drought-resistant and drought-susceptible genotypes. Drought-resistant genotypes retained 43.36% more water in leaves under well-watered conditions compared to water-limited conditions, while drought-susceptible genotypes retained only 15.69% more. The LWVI1 and LWVI2 indices, aligned with the RWC measurements, revealed a strong inverse correlation in the susceptible genotypes, underscoring their heightened sensitivity to water stress in earlier stages. Several genotypes previously classified based on their drought resistance showed spectral indices deviating from expectations. Results from this research can aid farmers in improving crop yields by informing early management practices. Moreover, this research offers wheat breeders insights into the selection of drought-tolerant genotypes, a requirement that is becoming increasingly important as weather patterns continue to change.

Roy, Bishal (ORCID:0000000199125505)↗

Object sense and avoid system for autonomous vehicles

A system for determining a travel path for an autonomous vehicle (“AV”) to travel to a target while avoiding objects (i.e., obstacles) without the use of an imaging system is provided. An object sense and avoid (“OSA”) system detects objects in an object field that is adjacent to the AV and dynamically generates, as the AV travels, a travel path to the target to avoid the objects. The OSA system repeatedly uses sensors to collect sensor data of any objects in the object field. An object detection system then detects the objects and determines their locations based on triangulating ranges to an object as indicated by different sensors. The path planner system then plans a next travel direction for the AV to avoid the detected objects while seeking to minimize the distance traveled. The OSA system then instructs the AV to travel in the travel direction.

Beer, N. Reginald↗

Autonomous Navigation and Control of UGVs' in Nuclear Power Plants - 20381

The purpose of the husky A200 ground robot is to autonomously navigate through the places where it is very hazardous for human beings to reach and operate, like nuclear power plants, chemical industries. The aim is to navigate the ground robot autonomously with an Arm mounted on the robot along with the different sensors as camera, and Lidar. The autonomous motion of the robot is controlled by the controller which uses path planner for trajectory generation of the robot. The mission planner uses the current position of the husky A200, given the way points of the initial and the destination it would extract a best possible route based on the current events provided using GMapping. The global reference frame is used for planning the way points. Creating the appropriate path and the actions required to follow the path are given by the motion planner. The motion planner depends on the active sensor data such as obstacles, lanes, based on the sensor data feasible path is generated. Feasibility of the path is determined by the dynamics of the husky and a series of points generated with certain velocity and acceleration profile. The controller adjusts the lateral, longitudinal and yaw motion of the husky to command the behaviors. The kinematic model is developed for kinematic motion of the husky and the dynamic model is developed for transient and steady state characteristics. The images and other type of data captured by the camera are processed through the computational framework used to build machine learning models. TensorFlow will be used for deep learning and to identify and classify different objects around the husky. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Laser ultrasonic imaging of subsurface defects with the linear sampling method

Laser ultrasonics is a remote nondestructive evaluation technique suitable for real-time monitoring of fabrication processes in semiconductor metrology, advanced manufacturing, and other applications where non-contact, high fidelity measurements are required. Here we investigate laser ultrasonic data processing approaches to reconstruct images of subsurface side drilled holes in aluminum alloy specimens. We demonstrate through simulation that the model-based linear sampling method (LSM) can perform accurate shape reconstruction of single and multiple holes and produce images with well-defined boundaries. We experimentally confirm that LSM produces images that represent the internal geometric features of an object, some of which may be missed by conventional imaging.

42 ENGINEERING↗

Parallel Quantum-Enhanced Sensing

Quantum metrology takes advantage of quantum correlations to enhance the sensitivity of sensors and measurement techniques beyond their fundamental classical limit, given by the shot-noise limit. The use of both temporal and spatial correlations present in quantum states of light can extend quantum-enhanced sensing to a parallel configuration that can simultaneously probe an array of sensors or independently measure multiple parameters. To this end, we use multispatial-mode bright twin beams of light, which are characterized by independent quantum-correlated spatial subregions in addition to quantum temporal correlations, to probe a four-sensor quadrant plasmonic array. We show that it is possible to independently and simultaneously measure local changes in refractive index for all four sensors with a quantum enhancement in sensitivity in the range of 22% to 24% over the corresponding classical configuration. Finally, these results provide a first step toward highly parallel spatially resolved quantum-enhanced sensing techniques and pave the way toward more complex quantum sensing and quantum imaging platforms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Videos, photos, and AI-derived grain size data associated with “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization”

NOTE: The manuscript associated with this data package is currently in review. The data may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final dataset and additional metadata. This data package is associated with the manuscript “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization” under review. This data package includes five data types: 1) raw photos and videos from drone survey and walking smartphone surveys; 2) images derived from raw videos; 3) manual labeling of reference scales; 4) metadata for all images and photo resolution derived from artificial intelligence (AI) models or manual labels, 5) grain size data obtained from AI models for all photos, 6) metadata and grain size data after quality control, 7) summaries of sample efficiency for all data, and 8) computational fluid dynamics (CFD) data used to support hydro-biogeochemical (HBGC) parameter estimation. Such data is used to 1) demonstrate significant improvements in accuracy, efficiency, and quality control for grain size data collection with the help of AI models, 2) study the spatial heterogeneity of grain size and observation reproducibility based on tens of thousands of data points generated by the AI models, and 3) evaluate the impacts of grain size heterogeneity on key HBGC parameters across sediment-to-reach and hourly-to-yearly scales. In particular, the data package contains 116 folders and 179696 files. The files include 41 videos in .mov format, 64047 photos in .jpg format, 13541 video-derived photos in .png format, 12747 segmentation mask data in .tif format, 12747 segmentation data in .json format, 24771 .csv files that with metadata and grain size for each individual photo as well as water depth and velocity data from CFD and observation, 51791 .txt files of raw AI predicted labels, and 11 flight record data in .srt format. The summary for all metadata and grain size statistics information is included in “Scales_V3_NG.csv” and “Statistics_V3_NG.csv”. The summary for data that pass data quality control (QC) level 0-2 is included in “QCStatistics_V3_NG.csv”. The QC level 0 represents photos whose photo resolution is positive, excluding photos that miss reference scale. The QC level 1 means reference scale circularity uncertainty is less than 5% for smartphone images while representing photo resolution is larger than 0.44 mm/pixel for drone images. The QC level 2 means excluding photos whose grain number is less than 100, a minimum number of grains recommended by classic literature. The summary for each video’s name, length, frame rates, survey area, grain number, survey efficiency, etc. can be found in “QCSummary_V3_NG.csv”. The summary for site name, GPS coordinates, and number of images at each site can be found in “SitesSummary_V3_*.csv” files. Overall computational efficiency summary is reported in Table 4 of accompanying manuscript. Additionally, the nitrate concentration data used in this work was downloaded from an existing dataset published on ESS-DIVE (Boat-Dragged Sensor Hanford Reach.csv; Conner A. et al., 2020). We thank the United States Forest Service, Washington Department of Fish and Wildlife, Washington Department of Natural Resources, Cowiche Canyon Conservatory, Port of Benton, and the Confederated Tribes and Bands of the Yakama Nation for access to field locations where the data were collected. We also thank the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate data collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗

Spot pattern welding scanning strategy for sensor embedding and residual stress reduction in laser-foil-printing additive manufacturing

Here, this paper aims to present spot pattern welding (SPW) as a scanning strategy for laser-foil-printing (LFP) additive manufacturing (AM) in place of the previously used continuous pattern welding (CPW) (line-raster scanning). The SPW strategy involves generating a sequence of overlapping spot welds on the metal foil, allowing the laser to form dense and uniform weld beads. This in turn reduces thermal gradients, promotes material consolidation and helps mitigate process-related risks such as thermal cracking, porosity, keyholing and Marangoni effects. 304L stainless steel (SS) feedstock is used to fabricate test specimens using the LFP system. Imaging techniques are used to examine the melt pool dimensions and layer bonding. In addition, the parts are evaluated for residual stresses, mechanical strength and grain size. Compared to CPW, SPW provides a more reliable heating/cooling relationship that is less dependent on part geometry. The overlapping spot welds distribute heat more evenly, minimizing the risk of elevated temperatures during the AM process. In addition, the resulting dense and uniform weld beads contribute to lower residual stresses in the printed part. To the best of the authors’ knowledge, this is the first study to thoroughly investigate SPW as a scanning strategy using the LFP process. In general, SPW presents a promising strategy for securing embedded sensors into LFP parts while minimizing residual stresses.

36 MATERIALS SCIENCE↗

Correcting for digital image correlation speckle inversion at high temperature using color cameras

Digital image correlation (DIC) is a popular, noncontacting technique to measure full-field deformation by using cameras to track the motion of an applied surface pattern. Because it is noncontacting, DIC can be performed for extreme temperature applications (e.g., hot-fire rocket testing of carbon composite rocket nozzles) under harsh conditions during which bonded gauges are damaged. Speckle pattern inversion is a phenomenon that sometimes occurs while performing high-temperature DIC. During speckle pattern inversion, portions of the surface pattern that were initially darker at room temperature (e.g., graphite) may emit more light due to blackbody radiation than the portions that were initially paler, thereby producing images in which the pattern appears inverted at high temperature relative to the initial pattern at room temperature. This phenomenon can prevent the correlation algorithm from being able to resolve the displacements between images. This work compares three methods to mitigate speckle pattern inversion: (A) the subtraction method, a recently-published technique in which two high-temperature images are subtracted to remove unwanted light; (B) the filtering method, a popular technique in which optical bandpass filters screen out unwanted light; and (C) the histogram rescaling method, a proposed new method that pairs a color camera with a blue light source and uses information from the green sensor of the camera to correct against inversion in the blue sensor through postprocessing. The histogram rescaling method is shown to successfully eliminate speckle pattern inversion and has the added advantages that it does not require quasi-static loading to be able to compensate for speckle pattern inversion, nor does it impose thick-glass distortions caused by the optical filter.

Rowley, Lindsey J.↗

Large-Scale Trajectory Analysis via Feature Vectors

The explosion of both sensors and GPS-enabled devices has resulted in position/time data being the next big frontier for data analytics. However, many of the problems associated with large numbers of trajectories do not necessarily have an analog with many of the historic big-data applications such as text and image analysis. Modern trajectory analytics exploits much of the cutting-edge research in machine-learning, statistics, computational geometry and other disciplines. We will show that for doing trajectory analytics at scale, it is necessary to fundamentally change the way the information is represented through a feature-vector approach. We then demonstrate the ability to solve large trajectory analytics problems using this representation.

58 GEOSCIENCES↗

Operational Uncrewed Aircraft Systems Development for Meteorology and Atmospheric Physics Field Campaign Report

The overarching goal of the project is to develop integrated small, unmanned aircraft systems (SUAS) capabilities for enhanced atmospheric physics measurements. This team included atmospheric scientists, meteorologists, engineers, computer scientists, geographers, and chemists necessary to evaluate the needs and develop the advanced sensing and imaging, robust autonomous navigation, enhanced data communication, and data management capabilities required to use SUAS in atmospheric physics. The flight campaigns at the Southern Great Plains (SGP) U.S. Department of Energy Atmospheric Radiation Measurement (ARM) observatory were an integrated evaluation of the systems in coordinated field tests. This enabled sensor testing, and validation of SUAS technology and integration of unmanned aircraft into the airspace. The set of experiments enabled evaluation and progression of remote UAS deployment operations with observing atmospheric sensors. Each flight test endeavor was notable for the significant lessons learned during every deployment event. Team size and roles, equipment use, aircraft instruments, meteorological instruments, and deployment logistics, were all evaluated and improved at every flight-testing day. The details of these are further discussed in the Results section.

54 ENVIRONMENTAL SCIENCES↗

Multiple-amplifier sensing charged-coupled device: model and improvement of the node removal efficiency

The multiple-amplifier sensing charge-coupled device (MAS-CCD) has emerged as a promising technology for astronomical observation, quantum imaging, and low-energy particle detection due to its ability to reduce the readout time for the same readout noise level compared with its predecessor, the skipper-CCD, by reading out the same charge packet through multiple inline amplifiers. Previous works identified a new parameter in this sensor, called node removal inefficiency (NRI), related to inefficiencies in charge transfer and residual charge removal from the sense node of each amplifier after readout. These inefficiencies can lead to distortions in the measured signals similar to those produced by the charge transfer inefficiencies in standard CCDs. We introduce more details in the mathematical model of the NRI mechanism and provide techniques to quantify its magnitude from the measured data. It also proposes a new operation strategy that significantly reduces its effect with minimal alterations of the timing sequences or voltage settings for the other signals of the sensor. The proposed technique is demonstrated experimentally on a 16-amplifier MAS-CCD. At the same time, the experimental data demonstrate that this approach minimizes the NRI effect to levels comparable with other sources of distortion such as the charge transfer inefficiency in scientific devices.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Single molecule insights into interfacial molecular recognition for model electrochemical DNA biosensors

Electrochemical sensors that use surface-immobilized DNA to bind analytes and transduce the binding into electrochemical signals, have the potential for rapid, specific, and sensitive detection of bioanalytes via a compact and portable platform. However, accessing the structure of these surfaces/interfaces at the relevant spatial scale (< 10 nm), which determines the interfacial interactions and ultimately sensing performance, remains an unsolved challenge. Here, we review studies that have used high resolution atomic force microscope imaging and spatial statistical analysis tools to understand crowding interactions between thiolated DNA probes immobilized on gold electrodes and how such interactions impact target binding. We also review related studies that attempt to control the nanoscale spatial arrangement of the immobilized recognition elements to optimize sensing performance. Furthermore, these efforts have led to new advances in understanding of the structure-function relationships of DNA-based electrochemical biosensors to move the field toward rational engineering of these biosensing interfaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Probing complex geophysical geometries with chattering dust

Abstract The modern energy economy and environmental infrastructure rely on the flow of fluids through fractures in rock. Yet this flow cannot be imaged directly because rocks are opaque to most probes. Here we apply chattering dust, or chemically reactive grains of sucrose containing pockets of pressurized carbon dioxide, to study rock fractures. As a dust grain dissolves, the pockets burst and emit acoustic signals that are detected by distributed sets of external ultrasonic sensors that track the dust movement through fracture systems. The dust particles travel through locally varying fracture apertures with varying speeds and provide information about internal fracture geometry, flow paths and bottlenecks. Chattering dust particles have an advantage over chemical sensors because they do not need to be collected, and over passive tracers because the chattering dust delineates the transport path. The current laboratory work has potential to scale up to near-borehole applications in the field.

58 GEOSCIENCES↗

Time-stamping and counting of single photons using fast camera

I will discuss fast optical cameras based on the back-illuminated silicon sensor and Timepix3 ASIC. The sensor has high quantum efficiency, and the chip provides nanosecond scale time resolution and data-driven readout with 80Mpix/sec bandwidth. The intensified version of the camera is single photon sensitive and since recently has been used for registration of single photons in a variety of quantum information science and quantum imaging experiments as well as for other applications. We briefly review the camera and describe recent experiments with a Hong-Ou-Mandel interferometer to characterize its photon counting capabilities.

79 ASTRONOMY AND ASTROPHYSICS↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection, was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability." More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture." Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multiscale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator.

59 BASIC BIOLOGICAL SCIENCES↗