Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Charged Particle Tracking via Edge-Classifying Interaction Networks

Recent work has demonstrated that geometric deep learning methods such as graph neural networks (GNNs) are well suited to address a variety of reconstruction problems in high-energy particle physics. In particular, particle tracking data are naturally represented as a graph by identifying silicon tracker hits as nodes and particle trajectories as edges, given a set of hypothesized edges, edge-classifying GNNs identify those corresponding to real particle trajectories. In this work, we adapt the physics-motivated interaction network (IN) GNN toward the problem of particle tracking in pileup conditions similar to those expected at the high-luminosity Large Hadron Collider. Assuming idealized hit filtering at various particle momenta thresholds, we demonstrate the IN’s excellent edge-classification accuracy and tracking efficiency through a suite of measurements at each stage of GNN-based tracking: graph construction, edge classification, and track building. The proposed IN architecture is substantially smaller than previously studied GNN tracking architectures; this is particularly promising as a reduction in size is critical for enabling GNN-based tracking in constrained computing environments. Furthermore, the IN may be represented as either a set of explicit matrix operations or a message passing GNN. Efforts are underway to accelerate each representation via heterogeneous computing resources towards both high-level and low-latency triggering applications.

accelerator physics↗

A semantics-driven framework to enable demand flexibility control applications in real buildings

Decarbonising and digitalising the energy sector requires scalable and interoperable Demand Flexibility (DF) applications. Semantic models are promising technologies for achieving these goals, but existing studies focused on DF applications exhibit limitations. These include dependence on bespoke ontologies, lack of computational methods to generate semantic models, ineffective temporal data management and absence of platforms that use these models to easily develop, configure and deploy controls in real buildings. This paper introduces a semantics-driven framework to enable DF control applications in real buildings. The framework supports the generation of semantic models that adhere to Brick and SAREF while using metadata from Building Information Models (BIM) and Building Automation Systems (BAS). The work also introduces a web platform that leverages these models and an actor and microservices architecture to streamline the development, configuration and deployment of DF controls. The paper demonstrates the framework through a case study, illustrating its ability to integrate diverse data sources, execute DF actuation in a real building, and promote modularity for easy reuse, extension, and customisation of applications. The paper also discusses the alignment between Brick and SAREF, the value of leveraging BIM data sources, and the framework's benefits over existing approaches, demonstrating a 75% reduction in effort for developing, configuring, and deploying building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Graph Neural Networks for low-energy event classification & reconstruction in IceCube

IceCube, a cubic-kilometer array of optical sensors built to detect atmospheric and astrophysical neutrinos between 1 GeV and 1 PeV, is deployed 1.45 km to 2.45 km below the surface of the ice sheet at the South Pole. The classification and reconstruction of events from the in-ice detectors play a central role in the analysis of data from IceCube. Reconstructing and classifying events is a challenge due to the irregular detector geometry, inhomogeneous scattering and absorption of light in the ice and, below 100 GeV, the relatively low number of signal photons produced per event. To address this challenge, it is possible to represent IceCube events as point cloud graphs and use a Graph Neural Network (GNN) as the classification and reconstruction method. The GNN is capable of distinguishing neutrino events from cosmic-ray backgrounds, classifying different neutrino event types, and reconstructing the deposited energy, direction and interaction vertex. Based on simulation, we provide a comparison in the 1 GeV–100 GeV energy range to the current state-of-the-art maximum likelihood techniques used in current IceCube analyses, including the effects of known systematic uncertainties. For neutrino event classification, the GNN increases the signal efficiency by 18% at a fixed background rate, compared to current IceCube methods. Alternatively, the GNN offers a reduction of the background (i.e. false positive) rate by over a factor 8 (to below half a percent) at a fixed signal efficiency. For the reconstruction of energy, direction, and interaction vertex, the resolution improves by an average of 13%–20% compared to current maximum likelihood techniques in the energy range of 1 GeV–30 GeV. The GNN, when run on a GPU, is capable of processing IceCube events at a rate nearly double of the median IceCube trigger rate of 2.7 kHz, which opens the possibility of using low energy neutrinos in online searches for transient events.

47 OTHER INSTRUMENTATION↗

SMALE: Enhancing Scalability of Machine Learning Algorithms on Extreme-Scale Computing Platforms

Deployment and execution of machine learning tasks on extreme-scale computing platforms face several significant technical challenges: 1) High computing cost incurred by dense networks – The computing workload of deep networks with densely-connected topology increases rapidly with the network size, imposing a non-scalable computing model of extreme-scale computing platforms; 2) Non-optimized workload distribution – Many advanced deep learning algorithms, e.g., sparsification and irregular net-work topology, produce very unbalanced workload distribution on extreme-scale computing platforms. The computation efficiency is greatly hindered by the incurred data and computation redundancies as well as long tails of the node with extensive workload; 3) Constraints in data movement and I/O bottle-neck – Inter-node data movement in extreme-scale computing platforms are associated with high energy and latency costs, and subject to the constraints of I/O bandwidth; and 4) Generalization of algorithm realization and acceleration on computing platforms – The large varieties of machine learning algorithms and structures of extreme-scale computing platforms make the derivation of a generalized algorithm realization and acceleration method very challenging, which, however, is the requirement by domain scientists and interested users. We call the above challenges Smale’s Problems in Machine Learning and Understanding for High-Performance Computing Scientific Discovery. The objective of our three-year research project is to develop a holistic innovation set at structure, assembly, and acceleration layers of machine learning algorithms to address the above challenges in algorithm deployment and execution. Three tasks are particularly performed, including: At the algorithm structure level, we investigate the techniques that can structurally sparsify on the topology of deep networks for computing workload reduction. We also study clustering and pruning techniques that can optimize the workload distributions over the extreme-scale computing platforms; At the algorithm assembly level, we derive a unified learning framework for unsupervised transfer learning and dynamic growing capabilities. Novel training methods are also exploited to enhance the training efficiency of the proposed framework; At the algorithm acceleration level, we will develop a series of techniques that can accelerate the computation of sparse matrix operations, which are one of the core executions in deep learning and optimize memory access of the concerned platforms. Our proposed techniques attack the fundamental problems in machine learning algorithms running on extreme-scale computing platforms by vertically integrating the solutions at three closely entangled layers, paving the long-term scaling path of machine learning applications under DOE context. Three tasks corresponding to the above respective research orientations are performed during the three-year project period with our collaborators at ORNL. The outcome of the proposed project is anticipated to form a holistic solution set of novel algorithms and network topologies, efficient training techniques, and fast acceleration methods to promote the computing scalability of the machine learning applications of particular interest to DOE.

97 MATHEMATICS AND COMPUTING↗

The Effect of Interlayer Delay on the Heat Accumulation, Microstructures, and Properties in Laser Hot Wire Directed Energy Deposition of Ti-6Al-4V Single-Wall

Laser hot wire directed energy deposition (LHW-DED) is a layer-by-layer additive manufacturing technique that permits the fabrication of large-scale Ti-6Al-4V (Ti64) components with a high deposition rate and has gained traction in the aerospace sector in recent years. However, one of the major challenges in LHW-DED Ti64 is heat accumulation, which affects the part quality, microstructure, and properties of as-built specimens. These issues require a comprehensive understanding of the layerwise heat-accumulation-driven process–structure–property relationship in as-deposited samples. In this study, a systematic investigation was performed by fabricating three Ti-6Al-4V single-wall specimens with distinct interlayer delays, i.e., 0, 120, and 300 s. The real-time acquisition of high-fidelity thermal data and high-resolution melt pool images were utilized to demonstrate a direct correlation between layerwise heat accumulation and melt pool dimensions. The results revealed that the maximum heat buildup temperature of the topmost layer decreased from 660 °C to 263 °C with an increase to a 300 s interlayer delay, allowing for better control of the melt pool dimensions, which then resulted in improved part accuracy. Furthermore, the investigation of the location-specific composition, microstructure, and mechanical properties demonstrated that heat buildup resulted in the coarsening of microstructures and, consequently, the reduction of micro-hardness with increasing height. Extending the delay by 120 s resulted in a 5% improvement in the mechanical properties, including an increase in the yield strength from 817 MPa to 859 MPa and the ultimate tensile strength from 914 MPa to 959 MPa. Cooling rates estimated at 900 °C using a one-dimensional thermal model based on a numerical method allowed us to establish the process–structure–property relationship for the wall specimens. The study provides deeper insight into the effect of heat buildup in LHW-DED and serves as a guide for tailoring the properties of as-deposited specimens by regulating interlayer delay.

36 MATERIALS SCIENCE↗

Probing elemental speciation in hydrochar produced from hydrothermal liquefaction of anaerobic digestates using quantitative X-ray diffraction

Valorization of hydrochar, a solid byproduct from hydrothermal liquefaction (HTL) of anaerobically-digested agriculture wastes (digestates), requires fundamental knowledge of elemental speciation. This study investigated the effects of reaction temperatures (320–360 °C), digestate pH (3.5–8), and digestate cellulose-to-lignin ratios (0.2–1.8) on the speciation (chemical form) and composition of organics and inorganics in hydrochars produced during hydrothermal treatment. Quantitative X-ray diffraction (XRD) method was the primary technique used to characterize hydrochars. The comprehensive XRD pattern processing including the Rietveld refinement protocols demonstrated that the organic phase was comprised of mostly crystalline monocyclic, heterocyclic, and polycyclic aromatics with diverse aliphatic and aromatic substituents, while the inorganic mineral phase consisted of calcium-phosphates, magnesium-phosphates, calcium-carbonates, and magnesium-carbonates. Further, XRD results were validated by the elemental yields of products and the distribution of chemical functionalities measured using solid-state nuclear magnetic resonance (NMR) spectroscopy. The characterization data were used to evaluate proposed mechanistic pathways using compositional analysis of biocrude and aqueous-phase coproducts. Mechanistic pathways developed in the study suggested that benzoic acids, phenols, benzaldehydes, phenolic aldehydes, α-dicarbonyls, and α-hydroxycarbonyls were responsible for the precipitation of organics through various reactions depending on operating conditions. Meanwhile, the formation of inorganic compounds appeared to be consistently represented by reactions including dehydration, hydrolysis, endergonic reduction, and structure rearrangement of native minerals in the digestates. This study provides basic knowledge needed to create and assess potential elemental speciation pathways. In addition, the results of the study facilitate the specification of process conditions to optimize targeted utilization routes of hydrochar for more economically-feasible and sustainable HTL processing.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A New Shape Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing

Minimizing the mass in electric machines while maintaining superior performance is a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization (TO) for lightweighting electric machines using traditional approaches typically explores a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods, such as cell-based density approaches, suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary optimization where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning-based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque, and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the International Energy Agency (IEA) 15-MW radial flux direct-drive wind turbine generator. The new approach to shape optimization resulted in smooth and concise shapes that can be easily additively manufactured with up to a 20-ton reduction in electrical steel mass.

additive manufacturing↗

Comparison of temperature adaptive calibration methods for laser induced fluorescence based fuel-in-oil instrument

Fuel dilution of engine oil (or fuel-in-oil, FiO) is an important issue as multiple and late-cycle fuel injection, integral to many combustion efficiency and emissions improvements (e.g., downsized boosted gasoline engines and catalyst thermal management) increases FiO rate. In addition to causing general wear and corrosion in engine due to decreased oil viscosity and pH buffering, FiO is also believed to cause destructive low speed pre-ignition (or super knock) in boosted SI engines. To understand the effects of engine operating conditions on the FiO rate, an optical diagnostic capable of measuring transient FiO on minute timescales was recently developed and demonstrated on a modified GM Ecotech engine system (Neupane et al., Applied Spectroscopy 2021). The measurement is based on adding a dye to the fuel and monitoring for its presence in oil via laser-induced fluorescence (LIF). The measured LIF signal is related to FiO concentration via pre-determined calibration factors using a multivariate classical least square (CLS) method.Since fluorescence quantum yield is a function of temperature, measured LIF intensity not only depends on FiO concentration but also oil temperature. To expand the applicability of the FiO diagnostic to transient oil-temperature conditions (e.g., cold start in practical engines), this study develops a method to account for oil-temperature variations. The effect of oil temperature (20°C - 95°C) on the LIF spectra of eight FiO samples ranging from ~0.8-15% was investigated. LIF intensities of the FiO samples decreased linearly with increasing temperature; the reductions being more significant at dye peaks. We develop a new calibration model (T-adaptive CLS) incorporating the temperature (T) effects on LIF intensity that enables simultaneous calculation of FiO and oil temperature. The improved FiO diagnostic with T-adaptive calibration is more robust, and applicable to varying oil-temperature conditions. For example, when strategies such as multiple/late fuel injections are applied to overcome cold-start instability due to use of low vaporization bio-based fuels such as ethanol, FiO rate is expected to be very high; the improved T-adaptive FiO diagnostic is hence relevant for engine- and fuel-system calibration and optimization. The diagnostic could also provide validation data for flow-field and spray interaction CFD models, further broadening the diagnostic’s utility for advancing engine technology and efficiency.

Neupane, Sneha↗

A New Shape Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing: Preprint

Minimizing the mass in electric machines while maintaining superior performance is a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization (TO) for lightweighting electric machines using traditional approaches typically explores a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods, such as cell-based density approaches, suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary TO where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning-based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque, and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the International Energy Agency (IEA) 15-MW radial flux direct-drive wind turbine generator. The free-form boundary TO resulted in smooth and concise shapes that can be easily additively manufactured with up to a 20-ton reduction in electrical steel mass.

additive manufacturing↗

Tensile properties of 3D-printed wood-filled PLA materials using poplar trees

Fabrication of renewable materials through additive manufacturing using wood-filled polylactic acid (PLA) is an emerging field of study. The variability in the tensile properties of 3D-printed materials due to the variability in woody biomass properties has not been studied. Biomass size reduction, filament extrusion, and 3D-printing methods were investigated to determine the conditions that resulted in consistent printing. Using 20% ball-milled poplar reinforcement in PLA, 210 °C filament extrusion temperature and 230 °C printing temperature were found to be the best conditions. Subsequently, seventy poplar samples from a common garden were used to test the tensile properties of the printed materials. The median tensile strength at yield was 50 MPa, with 5–95 percentiles ranged in 37–54 MPa. Strain% at break had a median value of 2.1%, and 5–95 percentiles were 1.7–2.7%. The median Young's modulus was 3.65 GPa, and 5–95 percentiles ranged in 2.9–4.1 GPa. Biomass density was correlated to composite density. Median particle size of ball-milled poplar was negatively correlated with tensile strength. Composite density affected tensile strength of the composite. β-glycosidic bond of polysaccharides in biomass affected Young's modulus of the composite. Overall, these data show that genotypic variation among Populus trichocarpa have substantial effect on tensile properties of 3D printed PLA-poplar materials.

36 MATERIALS SCIENCE↗

Mobility Energy Productivity Evaluation of Prediction-Based Vehicle Powertrain Control Combined with Optimal Traffic Management

Transportation vehicle and network system efficiency can be defined in two ways: 1) reduction of travel times across all the vehicles in the system, and 2) reduction in total energy consumed by all the vehicles in the system. The mechanisms to realize these efficiencies are treated as independent (i.e., vehicle and network domains) and, when combined, they have not been adequately studied to date. This research aims to integrate previously developed and published research on Predictive Optimal Energy Management Strategies (POEMS) and Intelligent Traffic Systems (ITS), to address the need for quantifying improvement in system efficiency resulting from simultaneous vehicle and network optimization. POEMS and ITS are partially independent methods which do not require each other to function but whose individual effectiveness may be affected by the presence of the other. In order to evaluate the system level efficiency improvements, the Mobility Energy Productivity (MEP) metric is used. MEP specifically measures the connectedness of a system while accounting for time and energy externalities of modes that provide mobility in a given location. A SUMO model is developed to reflect real traffic patterns in Fort Collins, Colorado and data is collected by a probe SUMO vehicle which is validated against data collected on a real vehicle driving the same routes through the city. Individual vehicle and system level efficiencies are calculated using SUMO outputs for scenarios which integrate POEMS and ITS independently as well as jointly. Results from application of POEMS and ITS show improvement in energy consumption and travel times respectively when compared to the respective baseline scenarios. Our conclusion is that there are promising synergistic benefits to travel time and energy efficiency when POEMS and ITS are combined.

ADVANCED PROPULSION SYSTEMS↗

Profitability, Scalability and Optimized Siting for Waste-to-Energy Supply Chains: A Case Study on Hydrothermal Liquefaction

Waste-to-Energy (WtE) conversion technologies have the potential to simultaneously reduce waste volumes, treatment-related emissions, and carbon intensity while producing valuable energy services. However, questions remain regarding under which conditions emerging WtE technologies are feasible to deploy. In this project, we develop an optimized siting method for WtE technologies to assess cost-effective WtE processor locations, throughput scales, and profitability. We apply the model using Hydrothermal Liquefaction (HTL) as an example WtE technology. We develop calibrated capital and operating expense cost curves based on literature data to study the techno-economic characteristics of WtE supply chains. Prior to solving the siting optimization, we analyze the model parameters to describe organic waste management system behavior under four different HTL deployment configurations: Co-Processing, where HTL plants send biocrude to existing conventional refineries via assumed pipelines; Co-Location, where biorefineries are co-located with HTL plants; and two alternative Standalone Biorefining cases, where distributed HTL plants transport biocrude intermediate via either assumed pipelines or trucking to centralized biorefineries. We also define and apply several feedstock gate fee calculations, representing different revenue distribution options, to investigate how bioproduct value could impact WtE supply chain economics in terms of waste producer and processor profit or cost reduction.

09 BIOMASS FUELS↗

Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems

We present an adaptive algorithm for constructing surrogate models of multi-disciplinary systems composed of a set of coupled components. With this goal we introduce “coupling” variables with a priori unknown distributions that allow surrogates of each component to be built independently. Once built, the surrogates of the components are combined to form an integrated-surrogate that can be used to predict system-level quantities of interest at a fraction of the cost of the original model. The error in the integrated-surrogate is greedily minimized using an experimental design procedure that allocates the amount of training data, used to construct each component-surrogate, based on the contribution of those surrogates to the error of the integrated-surrogate. Here, the multi-fidelity procedure presented is a generalization of multi-index stochastic collocation that can leverage ensembles of models of varying cost and accuracy, for one or more components, to reduce the computational cost of constructing the integrated-surrogate. Extensive numerical results demonstrate that, for a fixed computational budget, our algorithm is able to produce surrogates that are orders of magnitude more accurate than methods that treat the integrated system as a black-box.

42 ENGINEERING↗

Towards a unified nonlocal, peridynamics framework for the coarse-graining of molecular dynamics data with fractures

Molecular dynamics (MD) has served as a powerful tool for designing materials with reduced reliance on laboratory testing. However, the use of MD directly to treat the deformation and failure of materials at the mesoscale is still largely beyond reach. In this work, we propose a learning framework to extract a peridynamics model as a mesoscale continuum surrogate from MD simulated material fracture data sets. Firstly, we develop a novel coarse-graining method, to automatically handle the material fracture and its corresponding discontinuities in the MD displacement data sets. Inspired by the weighted essentially non-oscillatory (WENO) scheme, the key idea lies at an adaptive procedure to automatically choose the locally smoothest stencil, then reconstruct the coarse-grained material displacement field as the piecewise smooth solutions containing discontinuities. Then, based on the coarse-grained MD data, a two-phase optimization-based learning approach is proposed to infer the optimal peridynamics model with damage criterion. In the first phase, we identify the optimal nonlocal kernel function from the data sets without material damage to capture the material stiffness properties. Then, in the second phase, the material damage criterion is learnt as a smoothed step function from the data with fractures. As a result, a peridynamics surrogate is obtained. As a continuum model, our peridynamics surrogate model can be employed in further prediction tasks with different grid resolutions from training, and hence allows for substantial reductions in computational cost compared with MD. We illustrate the efficacy of the proposed approach with several numerical tests for the dynamic crack propagation problem in a single-layer graphene. Our tests show that the proposed data-driven model is robust and generalizable, in the sense that it is capable of modeling the initialization and growth of fractures under discretization and loading settings that are different from the ones used during training.

97 MATHEMATICS AND COMPUTING↗

Unexpected Roles of Triethanolamine in the Photochemical Reduction of CO 2 to Formate by Ruthenium Complexes

We show a series of 4,4'-dimethyl-2,2'-bipyridyl ruthenium complexes with carbonyl ligands were prepared and studied using a combination of electrochemical and spectroscopic methods with infrared detection to provide structural information on reaction intermediates in the photochemical reduction of CO 2 to formate in acetonitrile (CH 3 CN). An unsaturated 5-coordinate intermediate was characterized, and the hydride-transfer step to CO 2 from a singly reduced metal-hydride complex was observed with kinetic resolution. While triethanolamine (TEOA) was expected to act as a proton acceptor to ensure the sacrificial behavior of 1,3-dimethyl-2-phenyl-2,3-dihydro-1H-benzo[d]imidazole as an electron donor, time-resolved infrared measurements revealed that about 90% of the photogenerated one-electron reduced complexes undergo unproductive back electron transfer. Furthermore, TEOA showed the ability to capture CO 2 from CH 3 CN solutions to form a zwitterionic alkylcarbonate adduct and was actively engaged in key catalytic steps such as metal-hydride formation, hydride transfer to CO 2 to form the bound formate intermediate, and dissociation of formate ion product. Collectively, the data provide an overview of the transient intermediates of Ru(II) carbonyl complexes and emphasize the importance of considering the participation of TEOA when investigating and proposing catalytic pathways.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

AutoReP: Automatic ReLU Replacement for Fast Private Network Inference

The proliferation of the Machine-Learning-As-A-Service (MLaaS) market has brought to light a number of clients’ data privacy and security concerns. One promising solution is private inference (PI) techniques using cryptographic primitives. These techniques often come with high computation and communication overhead associated with the non-linear operator such as ReLU. Several approaches have been developed in reducing the number of ReLU operations, however, they either require a heuristic threshold selection or introduce significant accuracy drop. This work presents AutoReP, a gradient-based framework for non-linear operators reduction that aims to mitigate these concerns from a systematic perspective. AutoReP automates the process of discrete selection of ReLU and polynomial functions on neurons to accelerate PI applications. We also introduce distribution-aware polynomial approximation (DaPa) to accurately approximate ReLUs under given distribution, preserving model expressivity. Our experimental results demonstrate significant accuracy improvements of 6.12% (94.31%, 12.9K ReLU budget, CIFAR-10), 8.39% (74.92%, 12.9K ReLU budget, CIFAR-100), and 9.45% (63.69%, 55K ReLU budget, Tiny-ImageNet) over current state-of-the-art methods, e.g., SNL. Morever, AutoReP is applied to EfficientNet-B2 on ImageNet dataset, and achieved 75.55% accuracy with 176.1 × ReLU budget reduction.

Peng, Hongwu↗

Nonlinear Multiobjective MPC-Based Optimal Operation of a High Consistency Refining System in Papermaking

As one of the most important unit in the papermaking industry, the high consistency (HC) refining system is confronted with challenges such as improving pulp quality, energy saving, and emissions reduction in its operation processes. Here in this correspondence, an optimal operation of HC refining system is presented using nonlinear multiobjective model predictive control strategies that aim at set-point tracking objective of pulp quality, economic objective, and specific energy (SE) consumption objective, respectively. First, a set of input and output data at different times are employed to construct the subprocess model of the state process model for the HC refining system, and then the Wiener-type model can be obtained through combining the mechanism model of Canadian Standard Freeness and the state process model that determines their structures based on Akaike information criterion. Second, the multiobjective optimization strategy that optimizes both the set-point tracking objective of pulp quality and SE consumption is proposed simultaneously, which uses NSGA-II approach to obtain the Pareto optimal set. Furthermore, targeting at the set-point tracking objective of pulp quality, economic objective, and SE consumption objective, the sequential quadratic programming method is utilized to produce the optimal predictive controllers. In conclusion, the simulation results demonstrate that the proposed methods can make the HC refining system provide a better performance of set-point tracking of pulp quality when these predictive controllers are employed. In addition, while the optimal predictive controllers orienting with comprehensive economic objective and SE consumption objective, it has been shown that they have significantly reduced the energy consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗