Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network regularization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

National Solar Jobs Accelerator (Final Technical Report (FTR))

The aptitudes and experiences gained through military service—such as dynamic leadership, teamwork and critical thinking skills, technical specialization, and a mission-completion work ethic—make veterans exceptional candidates for a wide range of solar energy careers. The solar industry offers a highly collaborative and purpose-driven work environment that resonates with service members and veterans looking to rise to their next challenge, and solar employers are eager to tap into this valuable talent pool. From October 2019 - February 2023, The National Solar Jobs Accelerator (publicly the Solar Ready Vets Network TM (SRV Network; SRVN)) enhanced and streamlined options for military service members and veterans to pursue solar training, certification, and employment, while advancing solar employers’ efforts and capacity to invest in military talent as part of a long-term workforce development strategy. The SRVN was led by the Interstate Renewable Energy Council (IREC) in partnership with the Solar Energy Industries Association (SEIA), the US Chamber of Commerce Foundation’s Hiring Our Heroes program (HOH) and the North American Board of Certified Energy Practitioners (NABCEP). Through several direct-impact and indirect, high-impact capacity building initiatives aligned with six key objectives, the SRV Network strengthened solar career pathways, and promoted increased representation of military talent across all levels and sectors of the solar workforce. A work-based learning Corporate Fellowship model connected transitioning service members with on-the-job experience in leadership roles with solar employers nationwide. The project advanced broader veteran recruitment and talent development by expanding GI Bill eligibility and streamlining veterans’ pathways for solar training and credentialing, supported direct connections to jobs with top solar employers, and led coordination among key education and industry partners to advance registered apprenticeships aligned with solar career pathways. To ensure that the project best served the needs of all stakeholders, an Advisory Committee of military-connected solar professionals, solar employers, and training providers met biannually to guide project activities and sustainability plans. The project team engaged the broader “SRV Network” (comprised of over 2,000 veterans, employers and training organizations) through regular newsletters and targeted outreach to share resources, hiring fairs, webinars, and other opportunities for engagement. The work done under this award builds on the previous iterations of the Department of Energy’s Solar Ready Vets ® program. As the solar industry continues to grow rapidly over the next decade, the military community will continue to be a highly valuable source of talent. The relationships established and work accomplished through this project will have an enduring positive impact well beyond the funding period.

14 SOLAR ENERGY↗
DOE OSTI2021

Ps and Qs: Quantization-Aware Pruning for Efficient Low Latency Neural Network Inference

Efficient machine learning implementations optimized for inference in hardware have wide-ranging benefits, depending on the application, from lower inference latency to higher data throughput and reduced energy consumption. Two popular techniques for reducing computation in neural networks are pruning, removing insignificant synapses, and quantization, reducing the precision of the calculations. In this work, we explore the interplay between pruning and quantization during the training of neural networks for ultra low latency applications targeting high energy physics use cases. Techniques developed for this study have potential applications across many other domains. We study various configurations of pruning during quantization-aware training, which we term quantization-aware pruning, and the effect of techniques like regularization, batch normalization, and different pruning schemes on performance, computational complexity, and information content metrics. We find that quantization-aware pruning yields more computationally efficient models than either pruning or quantization alone for our task. Further, quantization-aware pruning typically performs similar to or better in terms of computational efficiency compared to other neural architecture search techniques like Bayesian optimization. Surprisingly, while networks with different training configurations can have similar performance for the benchmark application, the information content in the network can vary significantly, affecting its generalizability.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1988

Synchronization in neural nets

The paper presents an artificial neural network concept (the Synchronizable Oscillator Networks) where the instants of individual firings in the form of point processes constitute the only form of information transmitted between joining neurons. In the model, neurons fire spontaneously and regularly in the absence of perturbation. When interaction is present, the scheduled firings are advanced or delayed by the firing of neighboring neurons. Networks of such neurons become global oscillators which exhibit multiple synchronizing attractors. From arbitrary initial states, energy minimization learning procedures can make the network converge to oscillatory modes that satisfy multi-dimensional constraints. Such networks can directly represent routing and scheduling problems that consist of ordering sequences of events.

Vidal, Jacques J.↗
NASA NTRS2004

Statistical analysis of geodetic networks for detecting regional events

We present an application of hidden Markov models (HMMs) to analysis of geodetic time series in Southern California. Our model fitting method uses a regularized version of the deterministic annealing expectation-maximization algorithm to ensure that model solutions are both robust and of high quality.

geodetic networks↗
DOE OSTI2022

Deep-learning-guided high-resolution subsurface reflectivity imaging with application to ground-penetrating radar data

Subsurface reflectivity imaging is one of the most important geophysical characterization methods for revealing subsurface structures. In many cases, accurate subsurface reflectivity imaging is challenging because of, for example, random or coherent noise in the data and sparse source-receiver observation geometry. Here, we develop a deep-learning-guided iterative imaging method to improve subsurface structure imaging. Specifically, we train a supervised neural network to infer a noise-free, high-resolution image from a noisy, low-resolution image and use this estimated image as guidance to regularize least-squares imaging. We develop a systematic method to generate high-quality synthetic training data (data-label pairs) to train the guidance neural network. The trained neural network can provide high-fidelity predictions even for field-data images that are not in the training data. We validate our new imaging method using one synthetic and two field ground-penetrating radar data examples, and find that our method can produce clean, high-resolution subsurface reflectivity images where existing single-pass and least-squares imaging methods fail due to noise and insufficient data coverage.

58 GEOSCIENCES↗
DOE OSTI2024

A multiscale anisotropic polymer network model coupled with phase field fracture

The study of polymers has continued to gain substantial attention due to their expanding range of applications, spanning essential engineering fields to emerging domains like stretchable electronics, soft robotics, and implantable sensors. These materials exhibit remarkable properties, primarily stemming from their intricate polymer chain network, which, in turn, increases the complexity of precisely modeling their behavior. Especially for modeling elastomers and their fracture behavior, accurately accounting for the deformations of the polymer chains is vital for predicting the rupture in highly stretched chains. Despite the importance, many robust multiscale continuum frameworks for modeling elastomer fracture tend to simplify network deformations by assuming uniform behavior among chains in all directions. Recognizing this limitation, our study proposes a multiscale fracture model that accounts for the anisotropic nature of elastomer network responses. At the microscale, damage in the chains is assumed to be driven by both the chain's entropy and the internal energy due to molecular bond distortions. In order to bridge the stretching in the chains to the macroscale deformation, we employ the maximal advance path constraint network model, inherently accommodating anisotropic network responses. As a result, chains oriented differently can be predicted to exhibit varying stretch and, consequently, different damage levels. To drive macroscale fracture based on damages in these chains, we utilize the micromorphic regularization theory, which involves the introduction of dual local-global damage variables at the macroscale. The macroscale local damage variable is obtained through the homogenization of the chain damage values, resulting in the prediction of an isotropic material response. The macroscale global damage variable is subjected to nonlocal effects and boundary conditions in a thermodynamically consistent phase field continuum formulation. Moreover, the total dissipation in the system is considered to be mainly due to the breaking of the molecular bonds at the microscale. To validate our model, we employ the double-edge notched tensile test as a benchmark, comparing simulation predictions with existing experimental data. Additionally, to enhance our understanding of the fracturing process, we conduct uniaxial tensile experiments on a square film made up of polydimethylsiloxane (PDMS) rubber embedded with a hole and notches and then compare our simulation predictions with the experimental observations. Furthermore, we visualize the evolution of stretch and damage values in chains oriented along different directions to assess the predictive capacity of the model. In conclusion, the results are also compared with another existing model to evaluate the utility of our model in accurately simulating the fracture behavior of rubber-like materials.

42 ENGINEERING↗
NASA NTRS1987

The IHW island network

Early astronomical photography of comets at perihelion encouraged the establishment of an International Halley Watch (IHW) Team for regularly photographing the Comet. The February 1986 period was particularly troublesome due to the limitations of cometary visibility in the Southern Hemisphere. Schmidt cameras were placed on Tahiti, Easter Island, Faraday Station on the Antarctic Peninsula, Reunion Island and in South Africa. Blue- and red-filter B/W images were obtained every night and color prints were occasionally shot. Each night's images were examined before the next night's photography. Several interesting anecdotes are recounted from shipping, manning and operation of the telescopes.

Niedner, Malcolm B., Jr.↗
DOE OSTI2022

Physics-assisted generative adversarial network for X-ray tomography

X-ray tomography is capable of imaging the interior of objects in three dimensions non-invasively, with applications in biomedical imaging, materials science, electronic inspection, and other fields. The reconstruction process can be an ill-conditioned inverse problem, requiring regularization to obtain satisfactory results. Recently, deep learning has been adopted for tomographic reconstruction. Unlike iterative algorithms which require a distribution that is known a priori , deep reconstruction networks can learn a prior distribution through sampling the training distributions. In this work, we develop a Physics-assisted Generative Adversarial Network (PGAN), a two-step algorithm for tomographic reconstruction. In contrast to previous efforts, our PGAN utilizes maximum-likelihood estimates derived from the measurements to regularize the reconstruction with both known physics and the learned prior. Compared with methods with less physics assisting in training, PGAN can reduce the photon requirement with limited projection angles to achieve a given error rate. The advantages of using a physics-assisted learned prior in X-ray tomography may further enable low-photon nanoscale imaging.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Jensen–Shannon divergence based novel loss functions for Bayesian neural networks

Bayesian neural networks (BNNs) are state-of-the-art machine learning methods that can naturally regularize and systematically quantify uncertainties using their stochastic parameters. Kullback–Leibler (KL) divergence-based variational inference used in BNNs suffer from unstable optimization and challenges in approximating light-tailed posteriors due to the unbounded nature of the KL divergence. To resolve these issues, we formulate a novel loss function for BNNs based on a new modification to the generalized Jensen–Shannon (JS) divergence, which is bounded. In addition, we propose a Geometric JS divergence-based loss, which is computationally efficient since it can be evaluated analytically. We found that the JS divergence-based variational inference is intractable, and hence employed a constrained optimization framework to formulate these losses. Our theoretical analysis and empirical experiments on multiple regression and classification data sets suggest that the proposed losses perform better than the KL divergence-based loss, especially when the data sets are noisy or biased. Specifically, there are approximately 5% and 8% improvements in accuracy for a noise-added CIFAR-10 dataset and a regression dataset, respectively. There is about 13% reduction in false negative predictions of a biased histopathology dataset. Additionally, we quantify and compare the uncertainty metrics for the regression and classification tasks.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1989

Using radar ground-truth to validate and improve the location accuracy of a lightning direction-finding network

A technique is described in which isolated radar echoes associated with clusters of lightning strikes are used to validate and improve the location accuracy of a lightning-direction-finding network. Using this technique, site errors of a magnetic direction-finding network for locating lightning strikes to ground were accurately determined. The technique offers advantages over existing techniques in that large sample sizes are readily attainable over a broad area on a regular basis; the technique can also provide additional constraints to redundant data methods such as that described by Orville (1987). Since most lightning strike networks have either partial or full weather radar coverage, the technique is practical for all but a few users.

Goodman, Steven J.↗
DOE OSTI2021

The International Soil Moisture Network: serving Earth system science for over a decade

In 2009, the International Soil Moisture Network (ISMN) was initiated as a community effort, funded by the European Space Agency, to serve as a centralised data hosting facility for globally available in situ soil moisture measurements (Dorigo et al., 2011b, a). The ISMN brings together in situ soil moisture measurements collected and freely shared by a multitude of organisations, harmonises them in terms of units and sampling rates, applies advanced quality control, and stores them in a database. Users can freely retrieve the data from this database through an online web portal (https://ismn.earth/en/, last access: 28 October 2021). Meanwhile, the ISMN has evolved into the primary in situ soil moisture reference database worldwide, as evidenced by more than 3000 active users and over 1000 scientific publications referencing the data sets provided by the network. As of July 2021, the ISMN now contains the data of 71 networks and 2842 stations located all over the globe, with a time period spanning from 1952 to the present. The number of networks and stations covered by the ISMN is still growing, and approximately 70% of the data sets contained in the database continue to be updated on a regular or irregular basis. The main scope of this paper is to inform readers about the evolution of the ISMN over the past decade, including a description of network and data set updates and quality control procedures. A comprehensive review of the existing literature making use of ISMN data is also provided in order to identify current limitations in functionality and data usage and to shape priorities for the next decade of operations of this unique community-based data repository.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1989

Terminal attractors in neural networks

A new type of attractor (terminal attractors) for content-addressable memory, associative memory, and pattern recognition in artificial neural networks operating in continuous time is introduced. The idea of a terminal attractor is based upon a violation of the Lipschitz condition at a fixed point. As a result, the fixed point becomes a singular solution which envelopes the family of regular solutions, while each regular solution approaches such an attractor in finite time. It will be shown that terminal attractors can be incorporated into neural networks such that any desired set of these attractors with prescribed basins is provided by an appropriate selection of the synaptic weights. The applications of terminal attractors for content-addressable and associative memories, pattern recognition, self-organization, and for dynamical training are illustrated.

Zak, Michail↗
DOE OSTI2025

Bond-centric modular design of protein assemblies

Directional interactions that generate regular coordination geometries are a powerful means of guiding molecular and colloidal self-assembly, but implementing such high-level interactions with proteins remains challenging due to their complex shapes and intricate interface properties. Here we describe a modular approach to protein nanomaterial design inspired by the rich chemical diversity that can be generated from the small number of atomic valencies. We design protein building blocks using deep learning-based generative tools, incorporating regular coordination geometries and tailorable bonding interactions that enable the assembly of diverse closed and open architectures guided by simple geometric principles. Experimental characterization confirms the successful formation of more than 20 multicomponent polyhedral protein cages, two-dimensional arrays and three-dimensional protein lattices, with a high (10%–50%) success rate and electron microscopy data closely matching the corresponding design models. Due to modularity, individual building blocks can assemble with different partners to generate distinct regular assemblies, resulting in an economy of parts and enabling the construction of reconfigurable networks for designer nanomaterials.

Biomaterials – proteins↗
DOE OSTI2023

Alternatives to Contour Visualizations for Power Systems Data

Electrical grids are geographical and topological structures whose voltage states are challenging to represent accurately and efficiently for visual analysis. The current common practice is to use colored contour maps, yet these can misrepresent the data. We examine the suitability of four alternative visualization methods for depicting voltage data in a geographically dense distribution system - Voronoi polygons, H3 tessellations, S2 tessellations, and a network-weighted contour map. We find that Voronoi tessellations and network-weighted contour maps more accurately represent the statistical distribution of the data than regular contour maps.

MATHEMATICS AND COMPUTING,POWER TRANSMISSION AND D↗
NASA NTRS1988

Implementing neural nets with programmable logic

Networks of Boolean programmable logic modules are presented as one purely digital class of artificial neural nets. The approach contrasts with the continuous analog framework usually suggested. Programmable logic networks are capable of handling many neural-net applications. They avoid some of the limitations of threshold logic networks and present distinct opportunities. The network nodes are called dynamically programmable logic modules. They can be implemented with digitally controlled demultiplexers. Each node performs a Boolean function of its inputs which can be dynamically assigned. The overall network is therefore a combinational circuit and its outputs are Boolean global functions of the network's input variables. The approach offers definite advantages for VLSI implementation, namely, a regular architecture with limited connectivity, simplicity of the control machinery, natural modularity, and the support of a mature technology.

Vidal, Jacques J.↗
NASA NTRS1992

Model reduction for systems with integrators

The reduction algorithm for systems with integrators is derived. The algorithm is based on balancing the antigrammians and has the same computational effectiveness as the regular balancing procedure. It was applied to the reduction of the NASA Deep Space Network antenna model. As a result, the 90-state model has been reduced to a 27-state model, which preserves the full-model properties.

Gawronski, Wodek↗
NASA NTRS1994

The Nomad Explorer assembly assist vehicle: An architecture for rapid global extraterrestrial base infrastructure establishment

Traditional concepts of lunar bases describe scenarios where components of the bases are landed on the lunar surface, one at a time, and then put together to form a complete stationary lunar habitat. Recently, some concepts have described the advantages of operating a mobile or 'roving' lunar base. Such a base vastly improves the exploration range from a primary lunar base. Roving bases would also allow the crew to first deploy, test, operationally certify, and then regularly maintain, service, and evolve long life-cycle facilities like observatories or other science payload platforms that are operated far apart from each other across the extraterrestrial surface. The Nomad Explorer is such a mobile lunar base. This paper describes the architectural program of the Nomad Explorer, its advantages over a stationary lunar base, and some of the embedded system concepts which help the roving base to speedily establish a global extraterrestrial infrastructure. A number of modular autonomous logistics landers will carry deployable or erectable payloads, service, and logistically resupply the Nomad Explorer at regular intercepts along the traverse. Starting with the deployment of science experiments and telecommunication networks, and the manned emplacement of a variety of remote outposts using a unique EVA Bell system that enhances manned EVA, the Nomad Explorer architecture suggests the capability for a rapid global development of the extraterrestrial body. The Moon and Mars are candidates for this 'mission oriented' strategy. The lunar case is emphasized in this paper.

Thangavelu, Madhu↗
DOE OSTI2023

Alternatives to Contour Visualizations for Power Systems Data

Electrical grids are geographical and topological structures whose voltage states are challenging to represent accurately and efficiently for visual analysis. The current common practice is to use colored contour maps, yet these can misrepresent the data. We examine the suitability of four alternative visualization methods for depicting voltage data in a geographically dense distribution system-Voronoi polygons, H3 tessellations, S2 tessellations, and a network-weighted contour map. We find that Voronoi tessellations and network-weighted contour maps more accurately represent the statistical distribution of the data than regular contour maps.

MATHEMATICS AND COMPUTING↗