Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differentiability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Differentiable Neural Architecture, Mixed Precision and Accelerator Co-Search

Quantization, effective Neural Network architecture, and efficient accelerator hardware are three important design paradigms to maximize accuracy and efficiency. Mixed Precision Quantization is a process of assigning different precision to different Neural Network layers for optimized inference. Neural Architecture Search (NAS) is a process of automatically designing the neural network for a task and can also be extended to search for the precision of each weight and activation matrix. In this paper, we develop the following three methods: (i) Fast Differentiable Hardware-aware Mixed Precision Quantization Search method to find optimal precision, (ii) Joint Differentiable hardware-aware Architecture and Mixed Precision Quantization Co-search, (iii) Joint Accelerator, Architecture, and Precision triple co-search to find best possibilities in all the three worlds. We demonstrate the effectiveness of our proposed methods targeting Bitfusion accelerator by searching mixed precision models on MobilenetV2. We achieve better accuracy-latency trade-off models than the manually designed and previously proposed search methods.

97 MATHEMATICS AND COMPUTING↗

Denial of Service Attack Detection via Differential Analysis of Generalized Entropy Progressions

Denial-of-Service (DoS) attacks are one the most common and consequential cyber attacks in computer networks. While existing research offers a plethora of detection methods, the issue of achieving scalability, a low false positive rate, and high detection accuracy remains open. In this work, we address this problem by developing a differential method based on generalized entropy progression. In this method, named as DoDGE, we continuously fit the line of best fit to the entropy progression of destination addresses and check if the derivative, that is, the slope of this line is less than the negative of the dynamically computed standard deviation of the derivatives. Furthermore, to distinguish from flash events, we leverage the symmetry that when a flash event occurs, the derivative of the entropy progression of source addresses is positive. With this design, we omit the usage of the thresholds and the results with five real-world network traffic datasets confirm that DoDGE outperforms threshold-based DoS attack detection by two orders of magnitude in terms of false positives on average. When compared to ten machine learning (ML) models, DoDGE achieves a balanced accuracy of 99%, while the average balanced accuracy for the ML models is 52%. Moreover, the results show that DoDGE successfully differentiates between a flash event and a DoS attack. Furthermore, since the main computation cost of DoDGE is the entropy computation, which is linear in the volume of the unit-time network flow, uses integer only operations, and works on a small fraction of the total flow, it is lightweight and scalable.

Cybersecurity, wireless communication↗

Engineering Privacy at the Edge: A Practical Guide to Differential Privacy in System Architectures

The rapid expansion of distributed and edge computing platforms—spanning autonomous vehicles, IoT sensors, and healthcare monitors—has heightened concerns about data privacy. Differential Privacy (DP) offers a rigorous mathematical framework to protect sensitive information while retaining analytical utility. This tutorial introduces the foundations of DP for both numerical and categorical datasets and extends the discussion to correlation-aware techniques tailored for structured and high-dimensional data. Hands-on demonstrations will begin with the PETINA (Privacy prEservaTIoN Algorithms) package for numerical data and continue with MIC-DP (Maximum Information Correlated Differential Privacy) for tabular data. Designed for researchers and practitioners in secure systems, embedded architectures, and AI accelerators, the tutorial emphasizes practical and scalable methods for integrating DP into real-world system designs.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗

A Tale from the Trenches: Applying Metamorphic and Differential Testing to Bioinformatics Software

Metamorphic and differential testing have been proposed as best practices for testing software that is difficult to test, such as for programs in scientific domains. An assumption is that these approaches can be easily customized and applied to almost any domain. However, scientific software is often data-driven, and metamorphic relations may require significant domain knowledge to develop. In addition, tools are often written for ad-hoc experimentation by the scientists and often embed many assumptions about the importance and representation of different natural phenomena. In this paper, we present our experience applying both metamorphic and differential testing to a set of four computational biology tools that predict the growth of an organism. While our original goal was to evaluate these techniques to improve our system-level testing, we encountered multiple roadblocks along the way. Although we did find faults (some confirmed by developers), we also uncovered a set of challenges, including the considerable manual effort required for (a) defining domain-specific tests, (b) validating correctness, and (c) distinguishing between issues stemming from poor data and those arising from incorrect software.

Marsh, Alexis L [Iowa State University/Ames Labora↗

Measurement of Local Differential Privacy Techniques for IoT-based Streaming Data

Various Internet of Things (IoT) devices generate complex, dynamically changed, and infinite data streams. Adversaries can cause harm if they can access the user’s sensitive raw streaming data. For this reason, protecting the privacy of the data streams is crucial. In this paper, we explore local differential privacy techniques for streaming data. We compare the techniques and report the advantages and limitations. We also present the effect on component (e.g., smoother, perturber) variations of distribution-based local differential privacy. We find that combining distribution-based noise during perturbation provides more flexibility to the interested entity.

Afrose, Sharmin↗

Balancing Trade-offs: Adaptive Differential Privacy in Interpretable Machine Learning Models

In the advancing field of machine learning, balancing accuracy, interpretability, and privacy represents a significant challenge. The problem is exacerbated by the widespread deployment of pre-trained models locally in diverse applications, which could lead to various amounts of privacy leakage. Conventional Differential Privacy strategies, in which uniform noises are applied to model gradients, guarantee data privacy at the expense of accuracy and interpretability. This paper introduces a Feature-Sensitive Adaptive Differential Privacy (FADP) framework with a unique noise-adding strategy. Noises are adaptively added based on feature importance clustering, where important features are considered for interpretability. By employing a unique masking technique, FADP selectively preserves crucial features with minimal noise interference, maintaining accuracy while enhancing interpretability. The FADP framework addresses the limitations of traditional DP methods by preserving critical channels and improving interpretability — a vital requirement in machine learning applications that demand transparency in model decisions. Through comprehensive testing, FADP is shown to balance the trade-offs among accuracy, privacy, and interpretability, marking a substantial advancement in the field of privacy-preserving machine learning.

Farhad Riya, Farhin [University of Tennessee, Knox↗

A Quantum Approach for Implementing Fixed-Point Arithmetic in Solving Ordinary Differential Equations

Differential equations (DEs) serve as fundamental tools in mathematical modeling across scientific disciplines, yet classical numerical solvers face limitations with large-scale or computationally intensive problems. This study explores a quantum-inspired approach to solving DEs, combining quantum-inspired techniques with classical methods. It focuses on fixed-point arithmetic on quantum circuits, utilizing basic quantum gates to manipulate DE solutions. We expand upon the techniques introduced by Zanger et al. [Quantum, 5, 502 (2021)] by offering a precise computation for a fixed-point signed multiplication scheme, while also presenting a quantum circuit capable of executing the fixed-point division algorithm. We demonstrate the feasibility of our approach through the simulation of a linear Ordinary Differential Equation (ODE), where initial conditions and parameters are encoded into quantum circuits using fixed-point representation. By executing sequences of quantum gates mimicking numerical integration steps, we obtain approximate solutions to the ODE with specified fixed-point precision.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

MIC-DP: A Scalable Correlation-Aware Differential Privacy Framework for High-Dimensional Data

Conventional differential privacy (DP) assumes record independence, limiting effectiveness on real-world datasets with temporal, spatial, or structural correlations. These dependencies undermine privacy guarantees and degrade utility in domains like healthcare, IoT, and smart city analytics. We propose Maximum Information Correlated Differential Privacy (MIC-DP), a novel framework that dynamically calibrates noise based on statistical dependencies. MIC-DP uses the Maximum Information Coefficient (MIC) to capture both linear and nonlinear correlations without explicit modeling, enabling adaptive sensitivity adjustment and improved privacy–utility trade-offs. Evaluations on healthcare (MIMIC), demographic (ACI), and synthetic datasets show that MIC-DP reduces mean absolute error (MAE) by up to 5.2% under strict privacy budgets (ϵ≤1), with aggregate utility improvements reaching 18% across datasets and evaluation metrics. MIC-DP provides formal (ϵ,δ)-privacy guarantees, scales efficiently with feature count, and supports deployment in moderate-scale, privacy-sensitive applications. Its tunable performance and runtime efficiency make MIC-DP suitable for privacy-sensitive applications where low-latency analytics and strong privacy guarantees must coexist. These results demonstrate MIC-DP’s effectiveness as a correlation-aware solution for practical DP.

Yang, Wenjun [Univ. of Washington, Tacoma, WA (Uni↗

A Distributed Approach to Maximum Power Point Tracking for Photovoltaic Submodule Differential Power Processing

This paper presents the theory and implementation of a distributed algorithm for controlling differential power processing converters in photovoltaic (PV) applications. This distributed algorithm achieves true maximum power point tracking of series-connected PV submodules by relying only on local voltage measurements and neighbor-to-neighbor communication between the differential power converters. Compared to previous solutions, the proposed algorithm achieves reduced number of perturbations at each step and potentially faster tracking without adding extra hardware; all these features make this algorithm well-suited for long submodule strings. The formulation of the algorithm, discussion of its properties, as well as three case studies are presented. The performance of the distributed tracking algorithm has been verified via experiments, which yielded quantifiable improvements over other techniques that have been implemented in practice. Both simulations and hardware experiments have confirmed the effectiveness of the proposed distributed algorithm.

Qin, SB↗

The differential absorption hard x-ray spectrometer at the Z facility

The Differential Absorption Hard X-ray (DAHX) spectrometer is a diagnostic developed to measure time-resolved radiation between 60 keV and 2 MeV at the Z Facility. It consists of an array of 7 Si PIN diodes in a tungsten housing that provides collimation and coarse spectral resolution through differential filters. DAHX is a revitalization of the Hard X-Ray Spectrometer (HXRS) that was fielded on Z prior to refurbishment in 2006. DAHX has been tailored to the present radiation environment in Z to provide information on the power, spectral shape, and time profile of the hard emission by plasma radiation sources driven by the Z Machine.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees

We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.

97 MATHEMATICS AND COMPUTING↗

Colonies of the fungus Aspergillus niger are highly differentiated to adapt to local carbon source variation

Saprobic fungi, such as Aspergillus niger, grow as colonies consisting of a network ofbranching and fusing hyphae that are often considered to be relatively uniform entities inwhich nutrients can freely move through the hyphae. In nature, different parts of a colony areoften exposed to different nutrients. We have investigated, using a multi-omics approach,adaptation of A. niger colonies to spatially separated and compositionally different plantbiomass substrates. This demonstrated a high level of intra-colony differentiation, whichclosely matched the locally available substrate. The part of the colony exposed to pectin-richsugar beet pulp and to xylan-rich wheat bran showed high pectinolytic and high xylanolytictranscript and protein levels, respectively.This study therefore exemplifies the high ability of fungal colonies to differentiate and adaptto local conditions, ensuring efficient use of the available nutrients, rather than maintaining auniform physiology throughout the colony.

59 BASIC BIOLOGICAL SCIENCES↗

Different CT slice thickness and contrast‐enhancement phase in radiomics models on the differential performance of lung adenocarcinoma

Abstract Background To investigate the effects of computed tomography (CT) reconstruction slice thickness and contrast‐enhancement phase on the differential diagnosis performance of radiomic signature in lung adenocarcinoma. Methods A total of 187 patients who had been pathologically confirmed with lung adenocarcinoma and nonadenocarcinoma were divided into a training cohort ( n = 149) and validation cohort ( n = 38). All the patients underwent contrast‐enhanced CT and the images were reconstructed with different slice thickness. The radiomic features were extracted from different slice thickness and scan phase. The logistic regression (LR) algorithm was used to build a machine learning model for each group. The area under the curve (AUC) obtained from the receiver operating characteristic (ROC) curve and DeLong test was used to evaluate its discriminating performance. Results Finally, 34 image features and five semantic features were selected to establish a radiomics model. Based on the three contrast‐enhanced CT phases and four reconstruction slice thickness, 12 groups of radiomics models showed good discrimination ability with the AUCs range from 0.9287 to 0.9631, sensitivity range from 0.8349 to 0.9083, specificity range from 0.825 to 0.925 in the training group. Similar results were observed in the validation group. However, there was no statistical significance between the different CT scan phase groups and different slice thickness ( p > 0.05). Conclusions The radiomic analysis of contrast‐enhanced CT can be used for the differential diagnosis of lung adenocarcinoma. Moreover, different slice thickness and contrast‐enhanced scan phase did not affect the discriminating ability in the radiomics models.

Wang, Yang↗

Numerical Simulation of Solidification of Colloids Inside a Differentially Heated Cavity

Development of the solid–liquid interface, distribution of the particle concentration field, as well as the development of thermosolutal convection during solidification of colloidal suspensions in a differentially heated cavity are investigated. The numerical model is based on the one-fluid mixture approach combined with the single-domain enthalpy porosity model for phase change, and it is implemented in FLUENT software package. The linear dependence of the liquidus and solidus temperatures with the concentration of the nanoparticles was assumed. A colloidal suspension consisting of water and copper or alumina nanoparticles were considered. In the current investigation, the nanoparticle size selected was 5 and 2 nm. The suspension was solidified unidirectionally inside a square differentially heated cavity that was cooled from the left side. It was found that the solid–liquid interface changed its morphology from a planar shape to a dendritic one as the solidification process proceeds in time, due to the constitutional supercooling that resulted from the increased concentration of particles at the solid–liquid interface rejected from the crystalline phase. Initially, the flow consisted of two vortices rotating in opposite directions. However, at later times, only one counter clockwise rotating cell survived. Changing the material of the particle to alumina resulted in crystallized phase with a higher concentration of particles. If it is compared to that of the solid phase resulted from freezing the copper–water colloidal suspension. Furthermore, decreasing the segregation coefficient destabilizes the solid–liquid interface and increases the intensity of the convection cell with respect to that of the case of no particle rejection. At slow freezing rates, the resulting crystal phase consisted of lower particle content compared to the case of higher freezing rate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deposition of novel nanocomposite films by a newly developed differential pumping co-sputtering system

A differential pumping co-sputtering system was developed to facilitate a controlled, but flexible fabrication of multifunctional nanocomposite films with compositions not limited by thermodynamic restrictions. This system features a multichamber design with a differential pumping system. Dividing atmospheres with this set up greatly reduced the cross-contamination between chambers, and each material could be co-deposited by rapid rotation of the substrate. The clearance between the substrate holder and the chamber was set at 1-2 mm, and the conductance of the clearance was examined roughly using conductance equations for typical types of orifices. It was found that the potential difference (PD) value of the clearance between the two chambers was less than 0.01; the gas flow between the two chambers through the clearance thus appears to be a practical molecular flow. The PD value, where P is a pressure (Pa) and D is a diameter of an orifice or a pipe (m), is a gas flow indicator or parameter obtained from an equation of Knudsen number. The changes in the oxygen partial pressure and glow discharge plasma in the left chamber were investigated using a process gas monitor (PGM) and optical emission spectroscope (OES) by introducing different gases to each chamber. The PGM results revealed that the cross-contamination of oxygen from the other chamber was suppressed to 10 {+-} 3% of the original. In addition, the OES measurement for glow discharge plasma did not detect substantial oxygen contamination from the other chamber. Using the newly developed system, an AlN/SiO{sub x} nanocomposite film consisting of B4-type AlN and amorphous SiO{sub x} was obtained successfully.

36 MATERIALS SCIENCE↗

Energy Differential Response of Cancer Cells for Low Dose Irradiation:Impact of Monoenergetic Brachytherapy Sources

Purpose: The purpose of this work was to evaluate the energy differential response of cancer cells under identical dose exposure to asses the relevancy of mono-energetic sources for Brachytherapy treatments. Method and Materials: An electron energy spectrum impinging on lived breast cancer cell lines (MDA321) was obtained by placing a 19.65 {micro}Ci {sup 90}Sr/{sup 90}Y radioactive source in front of a non-uniform magnetic field constructed from two 5.08 x 5.0 cm x 2.54 cm neodimium ion permanent dipole magnets with a 1 cm separation gap. The cell lines were placed on the exit pole face of the magnet and were subsequently irradiated with different electron energies ranging from about 0.75 MeV to 1.85 MeV. The energy distribution was accurately measured with a scintillating fiber detector system that provided a 0.5% agreement with ICRU and a 5% energy resolution. The dosimetry was performed using a series of data acquired with a {sup 9}Sr/{sup 90}Y 4.5 mCi SIA-6 eye applicator, 6-21 MeV fixed energies from a Varian 2100 EX linac, EBT Gafchromic and Kodak ERT2 films, and an ion chamber detector. The accuracy of the dose rate obtained at different locations along and away from the magnet inside the cell containers was within 10.7%. Results: The cell lines were irradiated with a 0.5-4 Gy dose range. The data indicate a very strong differential energy response for electrons around 1 MeV (more lethal) compare to those with lesser or greater energy and a survival rate of at most 10% at very low dose (0.5-2 Gy). Conclusion: Mono-energetic Brachytherapy sources may provide a new pathway for radio-therapy treatment optimizations following a dedicated study showing very unusual high lethality in a specific energy window for MDA321 breast cancer cells.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Scaling law for noise variance and spatial resolution in differential phase contrast computed tomography

Purpose: The noise variance versus spatial resolution relationship in differential phase contrast (DPC) projection imaging and computed tomography (CT) are derived and compared to conventional absorption-based x-ray projection imaging and CT. Methods: The scaling law for DPC-CT is theoretically derived and subsequently validated with phantom results from an experimental Talbot-Lau interferometer system. Results: For the DPC imaging method, the noise variance in the differential projection images follows the same inverse-square law with spatial resolution as in conventional absorption-based x-ray imaging projections. However, both in theory and experimental results, in DPC-CT the noise variance scales with spatial resolution following an inverse linear relationship with fixed slice thickness. Conclusions: The scaling law in DPC-CT implies a lesser noise, and therefore dose, penalty for moving to higher spatial resolutions when compared to conventional absorption-based CT in order to maintain the same contrast-to-noise ratio.

60 APPLIED LIFE SCIENCES↗

TU-F-12A-04: Differential Radiation Avoidance of Functional Liver Regions Defined by 99mTc-Sulfur Colloid SPECT/CT with Proton Therapy

Purpose: Radiotherapy for hepatocellular carcinoma patients is conventionally planned without consideration of spatial heterogeneity in hepatic function, which may increase risk of radiation-induced liver disease. Pencil beam scanning (PBS) proton radiotherapy (pRT) plans were generated to differentially decrease dose to functional liver volumes (FLV) defined on [{sup 99m}Tc]sulfur colloid (SC) SPECT/CT images (functional avoidance plans) and compared against conventional pRT plans. Methods: Three HCC patients underwent SC SPECT/CT scans for pRT planning acquired 15 min post injection over 24 min. Images were reconstructed with OSEM following scatter, collimator, and exhale CT attenuation correction. Functional liver volumes (FLV) were defined by liver:spleen uptake ratio thresholds (43% to 90% maximum). Planning objectives to FLV were based on mean SC SPECT uptake ratio relative to GTV-subtracted liver and inversely scaled to mean liver dose of 20 Gy. PTV target coverage (V{sub 95}) was matched between conventional and functional avoidance plans. PBS pRT plans were optimized in RayStation for single field uniform dose (SFUD) and systematically perturbed to verify robustness to uncertainty in range, setup, and motion. Relative differences in FLV DVH and target dose heterogeneity (D{sub 2}-D{sub 98})/D50 were assessed. Results: For similar liver dose between functional avoidance and conventional PBS pRT plans (D{sub mean}≤5% difference, V{sub 18Gy}≤1% difference), dose to functional liver volumes were lower in avoidance plans but varied in magnitude across patients (FLV{sub 70%max} D{sub mean}≤26% difference, V{sub 18Gy}≤8% difference). Higher PTV dose heterogeneity in avoidance plans was associated with lower functional liver dose, particularly for the largest lesion [(D{sub 2}-D{sub 98})/D{sub 50}=13%, FLV{sub 90%max}=50% difference]. Conclusion: Differential avoidance of functional liver regions defined on sulfur colloid SPECT/CT is feasible with proton therapy. The magnitude of benefit appears to be patient specific and dependent on tumor location, size, and proximity to functional volumes. Further investigation in a larger cohort of patients may validate the clinical utility of functional avoidance planning of HCC radiotherapy.

60 APPLIED LIFE SCIENCES↗