Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Speech”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

InteraChem: Virtual Reality Visualizer for Reactive Interactive Molecular Dynamics

Interactive molecular dynamics in virtual reality (IMD-VR) simulations provide a digital molecular playground for students as an alternative or complement to traditional molecular modeling kits or 2D illustrations. Previous IMD-VR studies have used molecular mechanics to enable simulations of macromolecules such as proteins and nanostructures for the classroom setting with considerable success. Here, we present the InteraChem molecular visualizer, intended for reactive IMD-VR simulation using semiempirical and ab initio methods. InteraChem visualizes not only the molecular geometry but also (1) isosurfaces such as molecular orbitals and electrostatic potentials and (2) two-dimensional graphs of time-varying simulation quantities such as kinetic/potential energy, internal coordinates, and user-applied force. Additionally, InteraChem employs speech recognition to facilitate user interaction and introduces a novel “atom happiness” visualization using emojis to indicate the energetic feasibility of a particular bonding arrangement. Furthermore, we include a set of accompanying exercises that we have used to teach chemical reactivity in small molecular systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

COVID-19: Effects of Environmental Conditions on the Propagation of Respiratory Droplets

As coronavirus disease 2019 (COVID-19) continues to spread, a detailed understanding on the transmission mechanisms is of paramount importance. The disease transmits mainly through respiratory droplets and aerosol. Although models for the evaporation and trajectory of respiratory droplets have been developed, how the environment impacts the transmission of COVID-19 is still unclear. In this study, we investigate the propagation of respiratory droplets and aerosol particles generated by speech under a wide range of temperatures (0–40 °C) and relative humidity (0–92%) conditions. We show that droplets can travel three times farther in low-temperature and high-humidity environment, whereas the number of aerosol particles increases in high-temperature and low-humidity environments. The results also underscore the importance of proper ventilation, as droplets and aerosol spread significantly farther in airstreams. This study contributes to the understanding of the environmental impact on COVID-19 transmission.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Off-the-shelf deep learning is not enough, and requires parsimony, Bayesianity, and causality

Abstract Deep neural networks (‘deep learning’) have emerged as a technology of choice to tackle problems in speech recognition, computer vision, finance, etc. However, adoption of deep learning in physical domains brings substantial challenges stemming from the correlative nature of deep learning methods compared to the causal, hypothesis driven nature of modern science. We argue that the broad adoption of Bayesian methods incorporating prior knowledge, development of solutions with incorporated physical constraints and parsimonious structural descriptors and generative models, and ultimately adoption of causal models, offers a path forward for fundamental and applied research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Converting tabular data into images for deep learning with convolutional neural networks

Abstract Convolutional neural networks (CNNs) have been successfully used in many applications where important information about data is embedded in the order of features, such as speech and imaging. However, most tabular data do not assume a spatial relationship between features, and thus are unsuitable for modeling using CNNs. To meet this challenge, we develop a novel algorithm, image generator for tabular data (IGTD), to transform tabular data into images by assigning features to pixel positions so that similar features are close to each other in the image. The algorithm searches for an optimized assignment by minimizing the difference between the ranking of distances between features and the ranking of distances between their assigned pixels in the image. We apply IGTD to transform gene expression profiles of cancer cell lines (CCLs) and molecular descriptors of drugs into their respective image representations. Compared with existing transformation methods, IGTD generates compact image representations with better preservation of feature neighborhood structure. Evaluated on benchmark drug screening datasets, CNNs trained on IGTD image representations of CCLs and drugs exhibit a better performance of predicting anti-cancer drug response than both CNNs trained on alternative image representations and prediction models trained on the original tabular data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Quantum machine learning with differential privacy

Abstract Quantum machine learning (QML) can complement the growing trend of using learned models for a myriad of classification tasks, from image recognition to natural speech processing. There exists the potential for a quantum advantage due to the intractability of quantum operations on a classical computer. Many datasets used in machine learning are crowd sourced or contain some private information, but to the best of our knowledge, no current QML models are equipped with privacy-preserving features. This raises concerns as it is paramount that models do not expose sensitive information. Thus, privacy-preserving algorithms need to be implemented with QML. One solution is to make the machine learning algorithm differentially private, meaning the effect of a single data point on the training dataset is minimized. Differentially private machine learning models have been investigated, but differential privacy has not been thoroughly studied in the context of QML. In this study, we develop a hybrid quantum-classical model that is trained to preserve privacy using differentially private optimization algorithm. This marks the first proof-of-principle demonstration of privacy-preserving QML. The experiments demonstrate that differentially private QML can protect user-sensitive information without signficiantly diminishing model accuracy. Although the quantum model is simulated and tested on a classical computer, it demonstrates potential to be efficiently implemented on near-term quantum devices [noisy intermediate-scale quantum (NISQ)]. The approach’s success is illustrated via the classification of spatially classed two-dimensional datasets and a binary MNIST classification. This implementation of privacy-preserving QML will ensure confidentiality and accurate learning on NISQ technology.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Provider Perspectives: Identification and Follow-up of Infants who Are Deaf or Hard of Hearing

Objective Without timely screening, diagnosis, and intervention, hearing loss can cause significant delays in a child's speech, language, social, and emotional development. In 2019, Texas had nearly twice the average rate of loss to follow-up (LFU) or loss to documentation (LTD; i.e., missing documentation of services received) among infants who did not pass their newborn hearing screening compared to the United States overall (51.1 vs. 27.5%). We aimed to identify factors contributing to LFU/LTD among infants who do not pass their newborn hearing screening in Texas. Study Design Data were collected through semistructured qualitative interviews with 56 providers along the hearing care continuum, including hospital newborn hearing screening program staff, audiologists, primary care physicians, and early intervention (EI) program staff located in three rural and urban public health regions in Texas. Following recording and transcription of the interviews, we used qualitative data analysis software to analyze themes using a conventional content analysis approach. Results Frequently cited barriers included problems with family access to care, difficulty contacting patients, problems with communication between providers and referrals, lack of knowledge among providers and parents, and problems using the online reporting system. Providers in rural areas more often mentioned problems with family access to care and contacting families compared to providers in urban areas. Conclusion These findings provide insight into strategies that public health professionals and health care providers can use to work together to help further increase the number of children identified early who may benefit from EI services. Key Points

Obstetrics & Gynecology↗
DOE OSTI2025

Audible enclaves crafted by nonlinear self-bending ultrasonic beams

Delivering audible content to a targeted listener without disturbing others is paramount in audio engineering. However, achieving this goal has long been challenging due to the diffraction of low-frequency (long-wavelength) audio waves in linear acoustics. Here, we introduce an approach for creating remote audio spots, dubbed audible enclaves, by harnessing the local nonlinear interaction of two self-bending ultrasonic beams with distinct spectra. The self-bending ultrasonic beams created by acoustic metasurfaces, though inaudible, can bypass obstacles such as human heads. At their intersection behind obstacles, highly localized audible enclaves are formed due to the local nonlinear interactions. Additionally, we demonstrate the ultrabroadband capabilities of our metasurface-based implementation both numerically and experimentally, spanning from 125 Hz to 4 kHz (6 octave bands), covering the majority of the audible frequency range. The practicality of our proposed technique is underscored by its compact implementation size (0.16 m, equivalent to 0.06 wavelengths at 125 Hz), as well as its robust performance under wideband transient audio signal excitation and in a common room with reverberations. Our proposed audible enclaves hold significant potential for various applications in advanced audio engineering, including private speech communications, immersive spatial audio reproduction, and high-resolution sound/quiet zone control.

Science & Technology - Other Topics↗
DOE OSTI2023

Accelerating accurate simulations of calorimeter showers with normalizing flows and probability density distillation

Recently, we introduced caloflow, a high-fidelity generative model for GEANT4 calorimeter shower emulation based on normalizing flows. Here, we present caloflow v2, an improvement on our original framework that speeds up shower generation by a further factor of 500 relative to the original. The improvement is based on a technique called probability density distillation, originally developed for speech synthesis in the machine learning literature, and which we develop further by introducing a set of powerful new loss terms. We demonstrate that caloflow v2 preserves the same high fidelity as the original using qualitative (average images, histograms of high-level features) and quantitative (classifier metric between geant4 and generated samples) measures. The result is a generative model for calorimeter showers that matches the state of the art in speed (a factor of 10 4 faster than GEANT4) and greatly surpasses the previous state of the art in fidelity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A pilot study: Auditory steady-state responses (ASSR) can be measured in human fetuses using fetal magnetoencephalography (fMEG)

Auditory steady-state responses (ASSRs) are ongoing evoked brain responses to continuous auditory stimuli that play a role for auditory processing of complex sounds and speech perception. Transient auditory event-related responses (AERRs) have previously been recorded using fetal magnetoencephalography (fMEG) but involve different neurological pathways. Previous studies in children and adults demonstrated that the cortical components of the ASSR are significantly affected by state of consciousness and by maturational changes in neonates and young infants. To our knowledge, this is the first study to investigate ASSRs in human fetuses. 47 fMEG sessions were conducted with 24 healthy pregnant women in three gestational age groups (30–32 weeks, 33–35 weeks and 36–39 weeks). The stimulation consisted of amplitude-modulated (AM) tones with a duration of one second, a carrier frequency (CF) of 500 Hz and a modulation frequency (MF) of 27 Hz or 42 Hz. Both tones were presented in a random order with equal probability adding up to 80–100 repetitions per tone. The ASSR across trials was quantified by assessing phase synchrony in the cortical signals at the stimulation frequency. Ten out of 47 recordings were excluded due to technical problems or maternal movements. Analysis of the included 37 fetal recordings revealed a statistically significant response for the phase coherence between trials for the MF of 27 Hz but not for 42 Hz. An exploratory subgroup analysis moreover suggested an advantage in detectability for fetal behavioral state 2F (active asleep) compared to 1F (quiet asleep) detected using fetal heart rate. In conclusion, this pilot study is the first description of a method to detect human ASSRs in fetuses. The findings warrant further investigations of the developing fetal brain.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗
DOE OSTI2022

International ACM Symposium on High Performance Parallel and Distributed Computing Conference for 2017, 2018, 2019, and 2020

The 28th ACM HPDC Conference was held in Phoenix, Arizona, June 24 and 28, 2019 (hpdc.org/2019), that was colocated with ACM FCRC 2019 (fcrc.acm.org). During the conference, Prof. Geoffrey Fox, Indiana University, was given the HPDC Achievement Award for 2019. Prof gave a keynote speech entitled “Perspectives on High-Performance Computing in a Big Data World. In addition, to the keynote speakers from HPDC and FCRC conferences, the conference organized successfully five workshops and one Ph.D. forum. The ACM FCRC had a total of 2700 attendees, and HPDC had a total of 120 attendees that included 32 students. We have used the DOE sponsorship to support the conference proceedings that acknowledge the DoE support and partially supported the travel to the HPDC PC meeting, Keynote speaker accommodation, best papers, presentation and poster award.

42 ENGINEERING↗
DOE OSTI2022

Power System Waveform Classification Using Time-Frequency and CNN

Many modern reclosers and circuit breakers have microprocessor relays that record waveforms of system events. In some cases, utilities may record a half-a-dozen event captures for every event. This is thousands of events per year. The industry needs faster, more automated, more conclusive, and easy-to-use systems that can process massive amounts of event recordings without extensive input/support from power system engineers. To address the need for a commercially viable solution that can classify waveform data, energies were directed to develop a universal neural network (NN) structure (deep learning algorithm) that works for a wide variety of system event types. The structure that showed the most promise was one that included the use of spectrograms. The technique has shown positive results in audio engineering, particularly with respect to speech recognition. A waveform signature could be treated as a spoken word like audio waveforms for specific things such as “YES” or “UP”. No two people produce the exact same waveform when speaking each of these words, but audio processing algorithms based on spectrograms and convolutional neural networks (CNN) can still distinguish the word regardless of the speaker. No two circuits produce the exact same waveform for a given event, but the NN can be trained to classify the event type regardless of the circuit or location on the circuit. A Power System Neural Network (PSNN) has been developed to use a CNN to classify events within waveform data for power systems. The waveform is converted to an array of values by way of spectrograms and interpreted as an image. This image is passed into the CNN. The test results on independent simulated test and validation datasets show greater than 99% accuracy. While the results thus far are based on simulated data, the performance of the PSNN is very promising and should work for a wide variety of power system conditions of interest. Ultimately, much of the custom code and tools used today and much of the manual effort expended today may be automated using this PSNN.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Los Alamos National Laboratory Director's Strategic Resilience Initiative

The Director’s Strategic Resilience Initiative was created late in 2019 in recognition of the changing geo-political climate. The renewed strategic competition between Russia, China, and the United States, noted in the 2018 National Defense Strategy and the 2018 Nuclear Posture Review, put great power rivalry and competition at the forefront of national security considerations. At the same time, Russian President Vladimir Putin’s March 1, 2018, speech and China’s October 1, 2019, National Day Military Parade, underscored the nuclear dimensions of this new strategic competition. Accompanying this changed strategic environment are rapid advances in an expansive array of relevant technological sectors including affordable and comprehensive global communication and reconnaissance assets, autonomous vehicles, quantum computing, advanced manufacturing, and artificial intelligence.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Universal Fourier Attack for Time Series

A wide variety of adversarial attacks have been proposed and explored using image and audio data. These attacks are notoriously easy to generate digitally when the attacker can directly manipulate the input to a model, but are much more difficult to implement in the real-world. In this paper we present a universal, time invariant attack for general time series data such that the attack has a frequency spectrum primarily composed of the frequencies present in the original data. The universality of the attack makes it fast and easy to implement as no computation is required to add it to an input, while time invariance is useful for real-world deployment. Additionally, the frequency constraint ensures the attack can withstand filtering. We demonstrate the effectiveness of the attack in two different domains, speech recognition and unintended radiated emission, and show that the attack is robust against common transform-and-compare defense pipelines.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Characterization of Peripheral Neurophotonic Systems for High-Performance Human-Computer Interfaces (CRADA Final Report)

As part of the Cyclotron Road program, Morphosis Inc. sought to investigate a non-invasive neuromuscular sensing approach for use as an intuitive and secure human–computer interface. These highly miniaturized, wearable neural interfaces were completely non-invasive and maintained stable, high-bandwidth, long-term access to a user’s actions, intent, and identity, while offering an exceptionally high signal-to-noise ratio compared to contemporary neural recording technologies. The widespread adoption of neural interfaces had the potential to reshape how people interact with technology, with profound societal impacts. Millions worldwide suffered from movement and/or speech disabilities, and these tools had the potential to democratize access to technology to enhance autonomy and quality of life. More broadly, interfaces capable of accurately conveying intentions and safeguarding identities could serve as a cornerstone for privacy, trust, and personal authenticity in digital environments. The use of thought-driven control of digitally enabled devices and governance of digital identities had the potential to revolutionize relationships with technology, transforming how people learn, communicate, and interact with the world.

42 ENGINEERING↗
DOE OSTI2025

AI foundation models for experimental fusion tasks

Artificial Intelligence (AI) foundation models, while successful in various domains of language, speech, and vision, have not been adopted in production for fusion energy experiments. This brief paper presents how AI foundation models can be used for fusion energy diagnostics, enabling, for example, visual automated logbooks to provide greater insights into chains of plasma events in a discharge, in time for between-shot analysis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

The effect of simultaneous exposure on the attention selection and integration of segments and lexical tones by Urdu-Cantonese bilingual speakers

In the perceptual learning of lexical tones, an automatic and robust attention-to-phonology system enables native tonal listeners to adapt to acoustically non-optimal speech, such as phonetic conflicts in daily communications. Previous tone research reveals that non-native listeners who do not linguistically employ lexical tones in their mother tongue may find it challenging to attend to the tonal dimension or integrate it with the segmental features. However, it is unknown whether the attentional interference initially caused by a maternal attentional system would continue influencing the non-optimal tone perception for simultaneous bilingual teenagers. From an endpoint in the age of language acquisition, we investigate whether the tone-specific attention mechanism developed by the Urdu-Cantonese simultaneous bilinguals is automatic enough to assist them in adapting to a phonetically-conflicting environment. Three groups of teenagers engaged in a four-condition ABX task: Urdu-Cantonese simultaneous bilinguals, Cantonese native listeners, and Urdu-speaking, late learners of Cantonese. The results showed that although the simultaneous bilinguals could phonologically process Cantonese tones in a Cantonese-like way under a conflict-free listening condition, they still failed in adapting to the phonetic conflicts, especially the segment-induced ones. It thus demonstrated that the simultaneous exposure and years of regular education in Hong Kong local schools still could not automatically guarantee simultaneous bilingual processing of Cantonese tones. In interpreting the findings, it hypothesized that, except for simultaneous exposure, the development of a tone-specific attention mechanism is also likely to be L1-inhibitory, tone experience-driven, and language-specific for simultaneous bilinguals.

Ning, Jinghong↗