Unsupervised Neural Network Adaptation at the Edge: A Design Space Exploration
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
In this paper, we present a scalable digital hardware accelerator based on non-volatile memory arrays capable of realizing deep convolutional spiking neural networks (SNNs). Our design studies are conducted using a compact model for spin-transfer torque random access memory (STT-RAM) devices. Large networks are realized by tiling multiple cores which communicate by transmitting spike packets via an on-chip routing network. Compared to an equivalent SRAM based core design, we show that the STT-RAM based design achieves nearly 15X higher GSOPS (Synaptic Operations per Second) per Watt per mm 2 making it a promising platform for realizing systems with significant area and power limitations.
Resiliently designed and constructed integrated gas-electric distribution networks (GEDNs) against natural disasters are crucial to social welfare. In this study, a two-stage robust optimisation-based co-expansion planning model is proposed to attain an integrated GEDN with a given resilience level, by optimising the investment strategies of hardening and selective expansion of power distribution feeders and natural gas pipelines, as well as the location and capacity of natural-gas-fired distributed generation. In the first stage, the overall annual investment and operation cost is minimised under normal operation conditions while in the second stage, the feasibility of the investment decisions under the identified worst-case natural disaster scenario is checked with an adjustable load shedding cost criterion. The proposed model is formulated as a mixed integer second-order cone programming problem with the column and constraint generation algorithm employed to seek the optimal solution. Case studies on two integrated GEDNs demonstrate the performance of the proposed methodology.
This paper presents a case study of a network microgrid orchestrator designed to allow coordinated operation of microgrids. Through Control Hardware in the Loop (CHIL), the proposed microgrid orchestrator was validated using, as case study two community-owned microgrids in Adjuntas, Puerto Rico. These two microgrids in Adjuntas were designed to provide affordable and reliable access to electricity to 14 businesses located in the town square. In its current design, these two microgrids operate independently from each other. This paper studies how networking them would increase their resiliency metrics while operating as an island. A distributed optimization is implemented in the microgrid orchestrator due to its superior scalability compared to centralized approach as well as to maintain data privacy. Two operational modes are considered in this study to showcase the advantages of networking microgrids: a) normal island, and b) degraded island. CHIL simulations are performed to validate the proposed microgrid orchestrator. CHIL results show meaningful resiliency improvements obtained by networking microgrids during contingencies such as loss of PV generation.
Contract efforts are focused on refining the Robust Design Methodology for Conceptual Aircraft Design. Robust Design Simulation (RDS) was developed earlier as a potential solution to the need to do rapid trade-offs while accounting for risk, conflict, and uncertainty. The core of the simulation revolved around Response Surface Equations as approximations of bounded design spaces. An ongoing investigation is concerned with the advantages of using Neural Networks in conceptual design. Thought was also given to the development of systematic way to choose or create a baseline configuration based on specific mission requirements. Expert system was developed, which selects aerodynamics, performance and weights model from several configurations based on the user's mission requirements for subsonic civil transport. The research has also resulted in a step-by-step illustration on how to use the AMV method for distribution generation and the search for robust design solutions to multivariate constrained problems.
The Data Management System (DMS) Advanced Development task provides for the development of concepts, new tools, DMS services, and for the testing of the Space Station DMS hardware and software. It also provides for the development of techniques capable of determining the effects of system changes/enhancements, additions of new technology, and/or hardware and software growth on system performance. This paper will address the built-in characteristics which will support network monitoring requirements in the design of the evolving DMS network implementation, functional and performance requirements for a real-time, multiprogramming, multiprocessor operating system, and the possible use of advanced development techniques such as expert systems and artificial intelligence tools in the DMS design.
Evolution in time-varying environments naturally leads to adaptable biological systems that can easily switch functionalities. Advances in the synthesis of environmentally responsive materials therefore open up the possibility of creating a wide range of synthetic materials which can also be trained for adaptability. We consider high-dimensional inverse problems for materials where any particular functionality can be realized by numerous equivalent choices of design parameters. By periodically switching targets in a given design algorithm, we can teach a material to perform incompatible functionalities with minimal changes in design parameters. We exhibit this learning strategy for adaptability in two simulated settings: elastic networks that are designed to switch deformation modes with minimal bond changes and heteropolymers whose folding pathway selections are controlled by a minimal set of monomer affinities. The resulting designs can reveal physical principles, such as nucleation-controlled folding, that enable such adaptability.
Telemetry and ground support equipment design and developments for Deep Space Network
The bandwidth of frequency domain measurement methods of electrical signals has usually been far greater than the bandwidth of time domain methods. The primary limits of the time domain approach have been the 20 to 30 GHz bandwidth limit for electronic waveform acquisition instrumentation, and the lack of usable electrical pulse generators for excitation of a test device. The bandwidth of frequency domain network analysis appears to have reached a plateau of between 100 to 200 GHz, while time domain measurement have improved markedly in both bandwidth and sensitivity with the introduction of the pulsed laser based electro-optic sampling approach. Network analysis or the measurement of device scattering parameters provides information necessary to the design of electronic network such as high frequency amplifiers, mixers, and phase shifter. The bandwidth of frequency domain network analysis is currently being exceeded by the next generations of high frequency transistors and devices. Thus the electro-optic approach is a natural means of extending network analysis into the range above 100 GHz by employing time domain methods. In this approach, a suitable electrical excitation pulse is generated and propagated along a transmission line toward a test device. In the picosecond domain, laser driven photoconductive switches provide a unique method of generating electrical transients. Several materials were studied for generating short electrical pulses using photoconductive switches. The various semiconductive materials tested for photoconductive switching, and the electro-optic measurement technique used to characterize the material performance are described.
The philosophy adopted by Cable and Wireless for the synchronization of its world-wide network is presented. The architectures of some clock systems already deployed and how network synchronization had been implemented at selected locations are discussed. This includes some innovative designs as the network spans both first and third world countries with a combination of North Amercan and European hierarchy equipment. Different parts of the global network are linked together by a combination of terrestrial microwave, submarine cable and satellite technology. The impact of synchronization on Intelsat Intermediate Data Rate (IDR) operation and the restoration of submarine cable systems are addressed.
There exists a need for designers and developers to have a method to conveniently test a variety of communications parameters for an overall system design. This is no different when testing network protocols as when testing modulation formats. In this report, we discuss a means of providing a networking test device specifically designed to be used for space communications. This test device is a PC-based Virtual Instrument (VI) programmed using the LabVIEW(TM) version 5 software suite developed by National Instruments(TM)TM. This instrument was designed to be portable and usable by others without special, additional equipment. The programming was designed to replicate a VME-based hardware module developed earlier at New Mexico State University (NMSU) and to provide expanded capabilities exceeding the baseline configuration existing in that module. This report describes the design goals for the VI module in the next section and follows that with a description of the design of the VI instrument. This is followed with a description of the validation tests run on the VI. An application of the error-generating VI to networking protocols is then given.
Distributed control in a networked environment is an irreplaceable feature in systems with remote sensors and actuators. Although distributed control was not originally designed to be networked, usage of off-the-shelf networking technologies has become so prevalent that control systems are desired to have access mechanisms similar to computer networks. However, proprietary transducer interfaces for network communications and distributed control overwhelmingly dominate this industry. Unless the lack of compatibility and interoperability among transducers is resolved, the mature level of access (that computer networking can deliver) will not be achieved in such networked distributed control systems. Standardization of networked transducer interfaces will enable devices from different manufacturers to talk to each other and ensure their plug-and-play capability. One such standard is the suite of IEEE 1451 for sensor network communication and transducer interfaces. The suite not only provides a standard interface for smart transducers, but also outlines the connection of an NCAP (network capable application processor) and transducers (through a transducer interface module TIM). This paper presents the design of the compliance testing of IEEE 1451.1 (referred to as Dot1) compatible NCAP-to-NCAP communications on a link-layer independent medium. The paper also represents the first demonstration of NCAP-to-NCAP communications with Dot1 compatibility: a tester NCAP and an NCAP under test (NUT).
Analysis discusses STACOM (state criminal justic communication) network topology program used to design and evaluate digital telecommunications networks STACOM employs ESAU-WILLIAMS technique to search for direct links between system terminations and regional switching center. Inputs include traffic data, terminal locations, and functional requirements.
There has been much recent interest in designing symmetry-aware neural networks (NNs) exhibiting relaxed equivariance. Such NNs aim to interpolate between being exactly equivariant and being fully flexible, affording consistent performance benefits. In a separate line of work, certain structured parameter matrices -- those with displacement structure, characterized by low displacement rank (LDR) -- have been used to design small-footprint NNs. Displacement structure enables fast function and gradient evaluation, but permits accurate approximations via compression primarily to classical convolutional neural networks (CNNs). In this work, we propose a general framework -- based on a novel construction of symmetry-based structured matrices -- to build approximately equivariant NNs with significantly reduced parameter counts. Our framework integrates the two aforementioned lines of work via the use of so-called Group Matrices (GMs), a forgotten precursor to the modern notion of regular representations of finite groups. GMs allow the design of structured matrices -- resembling LDR matrices -- which generalize the linear operations of a classical CNN from cyclic groups to general finite groups and their homogeneous spaces. We show that GMs can be employed to extend all the elementary operations of CNNs to general discrete groups. Further, the theory of structured matrices based on GMs provides a generalization of LDR theory focussed on matrices with cyclic structure, providing a tool for implementing approximate equivariance for discrete groups. We test GM-based architectures on a variety of tasks in the presence of relaxed symmetry. We report that our framework consistently performs competitively compared to approximately equivariant NNs, and other structured matrix-based compression frameworks, sometimes with a one or two orders of magnitude lower parameter count.
The NASA Space Communications and Navigation (SCaN) Testbed, an external payload onboard the International Space Station, is equipped with three software defined radios (SDRs) and a programmable flight computer. The purpose of the Testbed is to conduct inspace research in the areas of communication, navigation, and networking in support of NASA missions and communication infrastructure. Multiple reprogrammable elements in the end to end system, along with several communication paths and a semi-operational environment, provides a unique opportunity to explore networking concepts and protocols envisioned for the future Solar System Internet (SSI). This paper will provide a general description of the system's design and the networking protocols implemented and characterized on the testbed, including Encapsulation, IP over CCSDS, and Delay-Tolerant Networking (DTN). Due to the research nature of the implementation, flexibility and robustness are considered in the design to enable expansion for future adaptive and cognitive techniques. Following a detailed design discussion, lessons learned and suggestions for future missions and communication infrastructure elements will be provided. Plans for the evolving research on SCaN Testbed as it moves towards a more adaptive, autonomous system will be discussed.
Tanana Chiefs Conference (TCC) is the traditional tribal consortium for the 37 federally recognized Tribes and villages of Interior Alaska. TCC is based on a belief in tribal self-determination and the need for regional Native unity. TCC is a nonprofit organization that works toward meeting the needs and challenges for more than 10,000 Alaska Natives (mostly Alaskan Athabaskans) in Interior Alaska. With support from DOE-OIE’s Inter-Tribal Technical Assistance grant, TCC’s goal was to expand and build on the solid foundation of work that the existing TCC Energy Program established through the creation of the Interior Athabascan Energy Network (IAEN). More specifically, the IAEN was designed to create a network of village-based energy champions across the interior and hold quarterly teleconferences and annual inperson meetings. Among the greatest impacts of the IAEN were the creation and support of realistic, communitybased energy projects that produced tangible results such as fuel savings and skills and capacity development among local staff as well as establishment of an energy team that included TCC staff, Tribal participants, technical consultants, and support agencies. The DOE-TA funding allowed us to provide technical assistance to our Tribal communities to develop energy projects, and to foster a network consisting of Tribal community members and energy experts that has strengthened the ability in the region to troubleshoot energy issues, develop meaningful projects, envision a clean energy future, and to share project successes and challenges. The funding from DOE was a catalyst for growth, has created opportunities for learning and knowledge sharing, and has led to the development of cost saving energy projects. Most importantly, the DOE project allowed energy champions around the region to share their knowledge, experiences, and expertise to create place-based solutions and has forged inter-Tribal relationships that will continue to be an asset for years to come. Through information exchange that occurred at out IAEN annual meetings and other events, this technical assistance grant award has spurred a spinoff project that is focused on establishing a collaborative of independent utilities that work together to solve energy problems and share services to operate and maintain their electric utilities. We have indentified at least 10 and possibly 12 communities that are interested in collaborating in managing their utilities to reduce costs and increase reliability. As well, by identifying and supporting Community Energy Champions in the Interior villages and adding capacity to the TCC Energy Program, we were able to create actionable community energy plans, develop specific projects, and increase local capacity, skills, and literacy around clean energy initiatives.
Architected materials derive their properties from the geometric arrangement of their internal structural elements. Their designs rely on continuous networks of members to control the global mechanical behavior of the bulk. Here, in this study, we introduce a class of materials that consist of discrete concatenated rings or cage particles interlocked in three-dimensional networks, forming polycatenated architected materials (PAMs). We propose a general design framework that translates arbitrary crystalline networks into particle concatenations and geometries. In response to small external loads, PAMs behave like non-Newtonian fluids, showing both shear-thinning and shear-thickening responses, which can be controlled by their catenation topologies. At larger strains, PAMs behave like lattices and foams, with a nonlinear stress-strain relation. At microscale, we demonstrate that PAMs can change their shapes in response to applied electrostatic charges. The distinctive properties of PAMs pave the path for developing stimuli-responsive materials, energy-absorbing systems, and morphing architectures.
The present paper discusses the applicability of ART (Adaptive Resonance Theory) networks, and the Hopfield and Elastic networks, in problems of structural analysis and design. A characteristic of these network architectures is the ability to classify patterns presented as inputs into specific categories. The categories may themselves represent distinct procedural solution strategies. The paper shows how this property can be adapted in the structural analysis and design problem. A second application is the use of Hopfield and Elastic networks in optimization problems. Of particular interest are problems characterized by the presence of discrete and integer design variables. The parallel computing architecture that is typical of neural networks is shown to be effective in such problems. Results of preliminary implementations in structural design problems are also included in the paper.