Dynamically reconfigurable imager for real-time staring vision systems
Design and characterization of a high-performance multi-acuity, multi-window dynamicaly reconfigurable vision (DRV) CMOS imager for real-time staring vision systems is presented.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Design and characterization of a high-performance multi-acuity, multi-window dynamicaly reconfigurable vision (DRV) CMOS imager for real-time staring vision systems is presented.
This paper describes the design of a reconfigurable chip programmable at the transistor level and oriented to the implementation of Evolvable Hardware (EHW) experiements.
This paper discusses the development of a new family of reconfigurable robotic vehicles for use in exploration of the surfaces of Mars and other remote planets.
The current implementation of the Telecommunications Protocol Processing Subsystem Using Reconfigurable Interoperable Gate Arrays (TRIGA) is equipped with CFDP protocol and CCSDS Telemetry and Telecommand framing schemes to replace the CPU intensive software counterpart implementation for reliable deep space communication. We present the hardware/software co-design methodology used to accomplish high data rate throughput. The hardware CFDP protocol stack implementation is then compared against the two recent flight implementations. The results from our experiments show that TRIGA offers more than 3 orders of magnitude throughput improvement with less than one-tenth of the power consumption.
This paper describes a new reconfigurable analog array (MA) architecture and integrated circuit (IC) used to map analog circuits that can adapt to extreme temperatures under programmable control. Algorithm-driven adaptation takes place on the RAA IC. The algorithms are implemented in a separate Field Programmable Gate Array (FPGA) IC, co-located with the RAA in the extreme temperature environment. The experiments demonstrate circuit adaptation over a wide temperature range, from extremely low temperature of -180 C to high 120 C.
This paper details the design architecture, design methodology, and the advantages of the SpaceCube v2.0 high performance data processing system for space applications. The purpose in building the SpaceCube v2.0 system is to create a superior high performance, reconfigurable, hybrid data processing system that can be used in a multitude of applications including those that require a radiation hardened and reliable solution. The SpaceCube v2.0 system leverages seven years of board design, avionics systems design, and space flight application experiences. This paper shows how SpaceCube v2.0 solves the increasing computing demands of space data processing applications that cannot be attained with a standalone processor approach.The main objective during the design stage is to find a good system balance between power, size, reliability, cost, and data processing capability. These design variables directly impact each other, and it is important to understand how to achieve a suitable balance. This paper will detail how these critical design factors were managed including the construction of an Engineering Model for an experiment on the International Space Station to test out design concepts. We will describe the designs for the processor card, power card, backplane, and a mission unique interface card. The mechanical design for the box will also be detailed since it is critical in meeting the stringent thermal and structural requirements imposed by the processing system. In addition, the mechanical design uses advanced thermal conduction techniques to solve the internal thermal challenges.The SpaceCube v2.0 processing system is based on an extended version of the 3U cPCI standard form factor where each card is 190mm x 100mm in size The typical power draw of the processor card is 8 to 10W and scales with application complexity. The SpaceCube v2.0 data processing card features two Xilinx Virtex-5 QV Field Programmable Gate Arrays (FPGA), eight memory modules, a monitor FPGA with analog monitoring, Ethernet, configurable interconnect to the Xilinx FPGAs including gigabit transceivers, and the necessary voltage regulation. The processor board uses a back-to-back design methodology for common parts that maximizes the board real estate available. This paper will show how to meet the IPC 6012B Class 3A standard with a 22-layer board that has two column grid array devices with 1.0mm pitch. All layout trades such as stack-up options, via selection, and FPGA signal breakout will be discussed with feature size results. The overall board design process will be discussed including parts selection, circuit design, proper signal termination, layout placement and route planning, signal integrity design and verification, and power integrity results. The radiation mitigation techniques will also be detailed including configuration scrubbing options, Xilinx circuit mitigation and FPGA functional monitoring, and memory protection.Finally, this paper will describe how this system is being used to solve the extreme challenges of a robotic satellite servicing mission where typical space-rated processors are not sufficient enough to meet the intensive data processing requirements. The SpaceCube v2.0 is the main payload control computer and is required to control critical subsystems such as autonomous rendezvous and docking using a suite of vision sensors and object avoidance when controlling two robotic arms.
This paper will detail the use of SpaceCube in multiple space flight applications including the Hubble Space Telescope Servicing Mission 4 (HST-SM4), an International Space Station (ISS) radiation test bed experiment, and the main avionics subsystem for two separate ISS attached payloads. Each mission has had varying degrees of data processing complexities, performance requirements, and external interfaces. We will show the methodology used to minimize the changes required to the physical hardware, FPGA designs, embedded software interfaces, and testing.This paper will summarize significant results as they apply to each mission application. In the HST-SM4 application we utilized the FPGA resources to accelerate portions of the image processing algorithms more than 25 times faster than a standard space processor in order to meet computational speed requirements. For the ISS radiation on-orbit demonstration, the main goal is to show that we can rely on the commercial FPGAs and processors in a space environment. We describe our FPGA and processor radiation mitigation strategies that have resulted in our eight PowerPCs being available and error free for more than 99.99 of the time over the period of four years. This positive data and proven reliability of the SpaceCube on ISS resulted in the Department of Defense (DoD) selecting SpaceCube, which is replacing an older and slower computer currently used on ISS, as the main avionics for two upcoming ISS experiment campaigns. This paper will show how we quickly reconfigured the SpaceCube system to meet the more stringent reliability requirements
SpaceCube is a family of Field Programmable Gate Array (FPGA) based on-board science data processing systems developed at the NASA Goddard Space Flight Center (GSFC). The goal of the SpaceCube program is to provide 10x to 100x improvements in on-board computing power while lowering relative power consumption and cost. SpaceCube is based on the Xilinx Virtex family of FPGAs, which include processor, FPGA logic and digital signal processing (DSP) resources. These processing elements are leveraged to produce a hybrid science data processing platform that accelerates the execution of algorithms by distributing computational functions to the most suitable elements. This approach enables the implementation of complex on-board functions that were previously limited to ground based systems, such as on-board product generation, data reduction, calibration, classification, eventfeature detection, data mining and real-time autonomous operations. The system is fully reconfigurable in flight, including data parameters, software and FPGA logic, through either ground commanding or autonomously in response to detected eventsfeatures in the instrument data stream.
The paper presents an algorithm for control and safe landing of impaired multi-rotor drones when one or more motors fail simultaneously or in any sequence. It includes three main components: an identification block, a reconfigurable control block, and a decisions making block. The identification block monitors each motor load characteristics and the current drawn, based on which the failures are detected. The control block generates the required total thrust and three axis torques for the altitude, horizontal position and/or orientation control of the drone based on the time scale separation and nonlinear dynamic inversion. The horizontal displacement is controlled by modulating the roll and pitch angles. The decision making algorithm maps the total thrust and three torques into the individual motor thrusts based on the information provided by the identification block. The drone continues the mission execution as long as the number of functioning motors provide controllability of it. Otherwise, the controller is switched to the safe mode, which gives up the yaw control, commands a safe landing spot and descent rate while maintaining the horizontal attitude.
We present a modular, reconfigurable system for building large structures. This system uses discrete lattice elements, called digital materials, to reversibly assemble ultralight structures that are 99.7% air and yet maintain sufficient specific stiffness for a variety of structural applications and loading scenarios. Design, manufacturing, and characterization of modular building blocks are described, including struts, nodes, joints, and build strategies. Simple case studies are shown using the same building blocks in three different scenarios: a bridge, a boat, and a shelter. Field implementation and demonstration is supplemented by experimental data and numerical simulation. A simplified approach for analyzing these structures is presented which shows good agreement with experimental results.
We report the design, fabrication, and testing of electrically tunable metasurface k-space filters based on the low-loss, high-contrast phase-change material GSST and a transparent Si electrode heating architecture. A 10x10 array of PCM elements integrated with Si heaters was fabricated via foundry processes, and used to actively control the crystallinity of a metasurface consisting of GSST nano antennae. By selectively varying the structural state of individual PCM elements, specific k-vectors of transmitted light can effectively be filtered out, resulting in improved imaging quality by reducing the scattered light that reaches a detector. Optimized doping profiles in the Si heaters allow for uniform, low power, reliable and repeatable switching of the GSST state. Compared to other k-space filters, this new architecture is completely transparent to the wavelength of interest and can be actively reconfigured in real time with high performance, low power consumption and a small footprint. The 10x10 array device is a proof-of-concept demonstration that can enable high-resolution arbitrary wavefront synthesis and correction in the future, with key applications in optical communications, beam steering, remote sensing, and adaptive optics.
The applications of adaptive optics extend across multiple sectors, encompassing areas such as LiDAR, biological and chemical sensing, and free-space communications. In this study, we report on the design, fabrication, testing, and modeling of electrically reconfigurable metasurfaces using a low-loss high contrast phase change material, Ge2Sb2Se4Te integrated with an IR-transparent silicon microheater. Through this work, we introduce a reliable architecture for switching PCM-based metasurfaces within an integrated circuit configuration which is compatible with standard foundry fabrication processes. We demonstrate the capability of controlling the transmission of electromagnetic waves through the precise stimulation of PCM-based pixels, each spanning a few hundred microns, over numerous cycles. By leveraging PCM-based pixels, we unlock the potential to create metasurfaces encompassing a diverse range of functionalities such as dielectric filters, metalens, or beam steering devices, which is governed by the design of the meta-atoms. Further, we perform an in-depth investigation into the failure mechanism utilizing techniques such as Fourier transform IR spectroscopy (FTIR), transmission electron microscopy (TEM), energy dispersive spectroscopy (EDS), and thermal modeling. According to our results, due to a sharp temperature rise at the PCM/heater interface, we observe severe delamination of the PCM from the heater. More uniform PCM deposition, better adhesion at the PCM/heater interface, and a more uniform temperature distribution in the device could potentially mitigate the failure and lead to a longer life-time. By addressing these challenges, we aim to unlock the full potential of PCM-based devices and advance the field of adaptive optics.
Abstract Domain switching is crucial for achieving desired functions in ferroic materials that are used in various applications. Fast control of domains at sub‐nanosecond timescales remains a challenge despite its potential for high‐speed operation in random‐access memories, photonic, and nanoelectronic devices. Here, ultrafast laser excitation is shown to transiently melt and reconfigure ferroelectric stripe domains in multiferroic bismuth ferrite on a timescale faster than 100 picoseconds. This dynamic behavior is visualized by picosecond‐ and nanometer‐resolved X‐ray diffraction and time‐resolved X‐ray diffuse scattering. The disordering of stripe domains is attributed to the screening of depolarization fields by photogenerated carriers resulting in the formation of charged domain walls, as supported by phase‐field simulations. Furthermore, the recovery of disordered domains exhibits subdiffusive growth on nanosecond timescales, with a non‐equilibrium domain velocity reaching up to 10 m s −1 . These findings present a new approach to image and manipulate ferroelectric domains on sub‐nanosecond timescales, which can be further extended into other complex photoferroic systems to modulate their electronic, optical, and magnetic properties beyond gigahertz frequencies. This approach could pave the way for high‐speed ferroelectric data storage and computing, and, more broadly, defines new approaches for visualizing the non‐equilibrium dynamics of heterogeneous and disordered materials.
The intrinsic magnetic topological insulator MnBi 2 Te 4 is a promising platform for exploring quantum phases with nontrivial band topology and for enabling electrical control over coupled magnetic and electronic phase transitions. In-plane magnetic fields, in particular, offer a distinct means of tuning these properties by strengthening quantized Hall effects, enhancing surface energy gaps, and driving spin reorientation transitions. However, a systematic understanding of how such fields affect magnetotransport is limited. Here, the magnetotransport behavior of few-layer MnBi 2 Te 4 as a function of gate voltage, temperature, and magnetic field angle, with a primary focus on in-plane field effects, are investigated. A gate-tunable crossover in magnetoresistance is observed from positive to negative values under in-plane magnetic fields as the gate voltage is swept below the charge neutrality point at temperatures below the Néel temperature. The in-plane field drives a transition from the antiferromagnetic ground state to a ferromagnetic configuration with spins aligned in-plane, while simultaneously altering the electronic structure, as revealed by gate-dependent transport features. The angle-dependent measurements reveal strongly gate-tunable magnetotransport anisotropy. These results establish in-plane magnetic fields as an effective tuning parameter for modulating spin and charge transport in MnBi 2 Te 4 , advancing prospects for reconfigurable spintronic and topological devices.
Dynamically tunable optical materials and device architectures are essential for future photonic technologies, yet conventional solid metals lack the intrinsic tunability required for advanced functionalities. Gallium-based liquid metals (LMs) present an appealing alternative thanks to their distinctive mechanical and optical properties; however, their practical integration in tunable photonic elements remains largely unexplored. Here, in this study, an electrochemically controlled nanophotonic platform is demonstrated that integrates a dynamically reconfigurable LM ground plane with gold nanoantenna arrays within a microfluidic system, enabling precise and reversible modulation of optical resonances across the visible to mid-infrared spectral ranges. By employing moderate operational voltages (1.5–3.0 V), real-time tuning of high-resolution structural color patterns is achieved through nanoscale control of the interfacial gap between the LM and Au nanoantennas. This innovative platform facilitates electrically programmable, high-contrast color patterns suitable for dynamic optical displays, secure anti-counterfeiting labels, and imaging applications. Additionally, this platform enables tunable mid-infrared spectral responses, which may be utilized for chemical and biological sensing applications. This versatile integrated LM-based nanophotonic platform opens new paths toward multifunctional, actively tunable/reconfigurable photonic device and system technologies.
All-liquid molding can be used to transform a liquid into free-form solid constructs, while maintaining internal fluidity. Traditional biological scaffolds, such as cured pre-gels, are normally processed in solid state, sacrificing flowability and permeability. However, it is essential to maintain the fluidity of the scaffold to truly mimic the complexity and heterogeneity of natural human tissues. Here, this work molds an aqueous biomaterial ink into liquid building blocks with rigid shapes while preserving internal fluidity. The molded ink blocks for bone-like vertebrae and cartilaginous-intervertebral-disc shapes, are magnetically manipulated to assemble into hierarchical structures as a scaffold for subsequent spinal column tissue growth. It is also possible to join separate ink blocks by interfacial coalescence, different from bridging solid blocks by interfacial fixation. Generally, aqueous biomaterial inks are molded into shapes with high fidelity by the interfacial jamming of alginate surfactants. The molded liquid blocks can be reconfigured using induced magnetic dipoles, that dictated the magnetic assembly behavior of liquid blocks. The implanted spinal column tissue exhibits a biocompatibility based on in vitro seeding and in vivo cultivating results, showing potential physiological function such as bending of the spinal column.
Terahertz resonances embedded in crystalline heterostructures could close a spectral gap between conventional electronics and photonics while opening new windows on non-equilibrium lattice dynamics. We show that femtosecond optical screening of the depolarization field in epitaxial PbTiO3/SrTiO3 superlattices launches a collective polar mode that oscillates near 1 THz and coherently spans the entire mini-Brillouin zone. Wave-vector-resolved pump–probe X-ray diffraction resolves a nearly dispersion-less oscillation at 0.87 THz and 0.94 THz at the zone boundary and zone center, respectively, persisting for ~2.5 ps, corresponding to a weakly damped resonance. Dynamical phase-field simulations reveal the origin of the mode to mesoscopic rotation of closure-domain textures during the photo-excited transition from an unscreened to a screened electrostatic state. Varying the PbTiO3 and SrTiO3 ratio tunes the mode frequency continuously from 0.9 to 1.4 THz, providing a quantitative design rule for frequency-selectable THz oscillators in ferroelectric heterostructures. By coupling nanoscale polarization reconfiguration to long-wavelength coherent dynamics, this work establishes depolarization-field engineering to topology-driven THz functionality and expanding the landscape of collective lattice dynamics.
Abstract Dynamic control over the polarization state of light is foundational for many scientific and technological applications, yet it remains a challenge to dynamically tailor responses with arbitrary polarization bases over a broad bandwidth. Broadband metasurface systems that utilize microscale displacements between two metasurfaces to enable reconfigurable polarization responses within a predefined polarization basis are reported. The metasurface pairs form an interferometer, and the lateral displacements produce detour phase shifts within the interferometer beam paths that mediate polarization state tuning. It is shown how the metasurface systems can be designed using freeform topology optimization to enable tailorable elliptical birefringence responses over a large bandwidth and how cascaded metasurface systems can enable the mapping of input and output polarization states between any two points on the Poincare sphere. It is anticipated that these concepts will have utility in imaging, display, communications, and metrology applications in classical and quantum optical domains.