Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
NASA NTRS2007

Science and the Constellation Systems Program Office

An underlying tension has existed throughout the history of NASA between the human spaceflight programs and the external scientific constituencies of the robotic exploration programs. The large human space projects have been perceived as squandering resources that might otherwise be utilized for scientific discoveries. In particular, the history of the relationship of science to the International Space Station Program has not been a happy one. The leadership of the Constellation Program Office, created in NASA in October, 2005, asked me to serve on the Program Manager s staff as a liaison to the science community. Through the creation of my position, the Program Manager wanted to communicate and elucidate decisions inside the program to the scientific community and, conversely, ensure that the community had a voice at the highest levels within the program. Almost all of my technical contributions at NASA, dating back to the Apollo Program, has been within the auspices of what is now known as the Science Mission Directorate. However, working at the Johnson Space Center, where human spaceflight is the principal activity, has given me a good deal of incidental contact and some more direct exposure through management positions to the structures and culture of human spaceflight programs. I entered the Constellation family somewhat naive but not uninformed. In addition to my background in NASA science, I have also written extensively over the past 25 years on the topic of human exploration of the Moon and Mars. (See, for example, Mendell, 1985). I have found that my scientific colleagues generally have little understanding of the structure and processes of a NASA program office; and many of them do not recognize the name, Constellation. In many respects, the international ILEWG community is better informed. Nevertheless, some NASA decision processes on the role of science, particularly with respect to the formulation of a lunar surface architecture, are not well known, even in ILEWG. At the recent annual Lunar and Planetary Science Conference, I reviewed the evolution of the program as a function of Agency leadership and the constraints put on NASA by the President in his 2004 announcement. I plan to continue my long-time ILEWG tradition of reporting a personal view of the state of development of human exploration of the solar system, this time coming from within the program office tasked to implement the vision for the United States. The current NASA implementation of the Vision for Space Exploration is consistent with certain classical scenarios that have been discussed extensively in the literature. I will discuss the role of science within the Vision, both from official policy and from a de facto interaction. While science goals are not officially driving the implementation of the Vision, the tools of scientific exploration are integral to defining the extraterrestrial design environments. In this respect the sharing of results from international missions to the Moon can make significant contributions to the success of the future human activities.

Mendell, Wendell↗
NASA NTRS2001

Mobile camera-space manipulation

The invention is a method of using computer vision to control systems consisting of a combination of holonomic and nonholonomic degrees of freedom such as a wheeled rover equipped with a robotic arm, a forklift, and earth-moving equipment such as a backhoe or a front-loader. Using vision sensors mounted on the mobile system and the manipulator, the system establishes a relationship between the internal joint configuration of the holonomic degrees of freedom of the manipulator and the appearance of features on the manipulator in the reference frames of the vision sensors. Then, the system, perhaps with the assistance of an operator, identifies the locations of the target object in the reference frames of the vision sensors. Using this target information, along with the relationship described above, the system determines a suitable trajectory for the nonholonomic degrees of freedom of the base to follow towards the target object. The system also determines a suitable pose or series of poses for the holonomic degrees of freedom of the manipulator. With additional visual samples, the system automatically updates the trajectory and final pose of the manipulator so as to allow for greater precision in the overall final position of the system.

Seelinger, Michael J.↗
NASA NTRS2009

Synthetic Foveal Imaging Technology

Synthetic Foveal imaging Technology (SyFT) is an emerging discipline of image capture and image-data processing that offers the prospect of greatly increased capabilities for real-time processing of large, high-resolution images (including mosaic images) for such purposes as automated recognition and tracking of moving objects of interest. SyFT offers a solution to the image-data processing problem arising from the proposed development of gigapixel mosaic focal-plane image-detector assemblies for very wide field-of-view imaging with high resolution for detecting and tracking sparse objects or events within narrow subfields of view. In order to identify and track the objects or events without the means of dynamic adaptation to be afforded by SyFT, it would be necessary to post-process data from an image-data space consisting of terabytes of data. Such post-processing would be time-consuming and, as a consequence, could result in missing significant events that could not be observed at all due to the time evolution of such events or could not be observed at required levels of fidelity without such real-time adaptations as adjusting focal-plane operating conditions or aiming of the focal plane in different directions to track such events. The basic concept of foveal imaging is straightforward: In imitation of a natural eye, a foveal-vision image sensor is designed to offer higher resolution in a small region of interest (ROI) within its field of view. Foveal vision reduces the amount of unwanted information that must be transferred from the image sensor to external image-data-processing circuitry. The aforementioned basic concept is not new in itself: indeed, image sensors based on these concepts have been described in several previous NASA Tech Briefs articles. Active-pixel integrated-circuit image sensors that can be programmed in real time to effect foveal artificial vision on demand are one such example. What is new in SyFT is a synergistic combination of recent advances in foveal imaging, computing, and related fields, along with a generalization of the basic foveal-vision concept to admit a synthetic fovea that is not restricted to one contiguous region of an image.

Hoenk, Michael↗
NASA NTRS2003

Smart Camera System for Aircraft and Spacecraft

This paper describes a new approach to situation awareness that combines video sensor technology and synthetic vision technology in a unique fashion to create a hybrid vision system. Our implementation of the technology, called "SmartCam3D" (SC3D) has been flight tested by both NASA and the Department of Defense with excellent results. This paper details its development and flight test results. Windshields and windows add considerable weight and risk to vehicle design, and because of this, many future vehicles will employ a windowless cockpit design. This windowless cockpit design philosophy prompted us to look at what would be required to develop a system that provides crewmembers and awareness. The system created to date provides a real-time operations personnel an appropriate level of situation 3D perspective display that can be used during all-weather and visibility conditions. While the advantages of a synthetic vision only system are considerable, the major disadvantage of such a system is that it displays the synthetic scene created using "static" data acquired by an aircraft or satellite at some point in the past. The SC3D system we are presenting in this paper is a hybrid synthetic vision system that fuses live video stream information with a computer generated synthetic scene. This hybrid system can display a dynamic, real-time scene of a region of interest, enriched by information from a synthetic environment system, see figure 1. The SC3D system has been flight tested on several X-38 flight tests performed over the last several years and on an ARMY Unmanned Aerial Vehicle (UAV) ground control station earlier this year. Additional testing using an assortment of UAV ground control stations and UAV simulators from the Army and Air Force will be conducted later this year.

Delgado, Frank↗
NASA NTRS2011

Increased Intracranial Pressure and Visual Impairment Associated with Long-Duration Spaceflight

Although humans have been flying in space since the 1960s, more recent missions have revealed a new suite of physiological adaptations and consequences of space flight. Notably, 60% of long-duration crewmembers (ISS/MIR) and >25% of short-duration (Shuttle) crewmembers have reported subjective degradation in vision (based on debrief comments) (Gibson 2011). Decreased near-visual acuity was demonstrated in 46% of ISS/Mir and 21% of Shuttle crewmembers, resulting in a shift of up to 1-2 diopters in their refractive correction. It is likely that the recently revealed ophthalmic changes have been present since the first days of human space flight, but have been overlooked or attributed to other causations. The reported changes in vision have occurred at various time points throughout missions, with ranging degrees of visual degradation. Although some cases resolved upon return to Earth, several astronauts have not regained preflight visual acuity, indicating that the damage may be permanent. While observing these changes over the years, without other overt symptomology and with the given age range of the flying population, this has largely been attributed to an expected hyperopic shift due to aging. However, the availability of onboard analysis techniques, including visual acuity assessments, retinal imagery, and ultrasounds of the eye and optic nerve tracts, along with more detailed post-flight techniques, has led to the recent recognition of a wider syndrome. Along with vision changes, findings include flattening of the globe, swelling of the optic disc (papilledema), choroidal folds in the retina, swelling of the optic nerve sheath, and visual field defects. It is widely hypothesized that this constellation of findings may be explained by an elevation of intracranial pressure (ICP). Out of the 60% of long-duration astronauts that have reported a subjective degradation in vision, a subset (currently 10 astronauts) have developed this syndrome. The National Aeronautics and Space Administration (NASA) has made it a high priority to understand this syndrome and provide mitigation techniques to protect crewmembers from visual impairment. While there are many possible factors that could contribute to intracranial hypertension associated with spaceflight, the relative contribution of these, as well as the processes by which eye damage occurs as a result of intracranial hypertension, are not fully understood. The observed pathophysiological phenomena are extremely complex and it is likely that multiple factors contribute to their incidence, rather than one simple mechanism. This paper will define and examine the findings in detail, and expound upon the potential contributing factors and their relative contribution to this syndrome.

Marshall-Bowman, Karina↗
NASA NTRS2011

Straight Ahead in Microgravity

INTRODUCTION The subjective straight-ahead direction is a very basic perceptual reference for spatial orientation and locomotion. The perceived straight-ahead along the horizontal and vertical meridian is largely determined by both otolith and somatosensory inputs which are altered in microgravity. The Straight Ahead in Microgravity (SAM) experiment will be conducted on the International Space Station (ISS) to examine how this spatial processing changes as a function of spaceflight. METHODS Data will be collected before the flight, at one-month intervals during long-duration stay (180 days) on board ISS, and after return to Earth. Control studies will also be performed during parabolic flights. Three different protocols will be used in each test session: (1) Fixation: The subject will be asked to look at actual targets (normal vision) and then to imagine these same targets (occluded vision) in the straight-ahead direction. Targets will be located at near distance (arm s length, ~0.5m), medium distance (~1 m), and far distance (beyond 2 m). This task will be successively performed with subject s body aligned with the spacecraft interior, and with subject s body tilted forward and backward by an operator. (2) Saccades: The subject will be asked to make horizontal and vertical saccades, first relative to the spacecraft interior reference system, and then relative to the subject s head reference system. This task will be successively performed with subject s body aligned with the spacecraft interior, and with subject s body tilted in roll or in pitch by an operator. (3) Linear Vestibulo-Ocular Reflex (VOR): The subject will be asked to stare at actual visual targets (normal vision) at various distances (near, medium, far) in the straight-ahead direction. Vision will then be occluded, and the subject will be asked to continue staring at the same imagined targets while he/she is passively translated forward-backward, up-down, or side-to-side. The subject's body motion will be performed by the restrained operator while the subject is free-floating. EXPECTED RESULTS The coupling of downward gaze with vergence eye movements observed on Earth is expected to increase in microgravity. Saccadic eye movements made in darkness along perceived axes are expected to be more closely aligned with the body s longitudinal axis in 0g compared to 1g, as the reference system for spatial orientation moves from an allocentric (gravitational) to an egocentric (idiotropic) vector. Changes in the linear VOR will reflect adaptive changes in otolith-ocular reflex contributions to the perceived straight-ahead. DISCUSSION A change in an individual's egocentric reference might have negative consequences on evaluating the direction of an approaching object or on the accuracy of reaching movements or locomotion. Consequently, investigating how microgravity affects the egocenter is important for understanding the problems associated with long-term effects of microgravity on astronauts' and how they re-adapt to the return of gravitational forces on Earth or other planetary surfaces. This project therefore has theoretical, practical and even clinical implications for the sensorimotor research gap "What are the changes in sensorimotor function over the course of a mission?"

Clement, G.↗
NASA NTRS2014

The Relationship Between CO2 Levels and CO2 Related Symptoms Reported on the ISS

Medical Operations, Toxicology, and the Lifetime Surveillance of Astronaut Health collaborated to assess the association of CO2 levels on board the International Space Station and USOS crew reported symptoms inflight, i.e. headache and vision changes. Private Medical Conference (PMC) documents and the weekly Space Medicine Operations Team (SMOT) Notes were used to provide a robust data set of inflight medical events. All events and non‐events were documented independent of CO2 levels and other potential contributors. Average (arithmetic mean) and single point maximum ppCO2 was calculated for the 24 hours and 7 days prior to the PMC or SMOT date and time provided by LSAH. Observations falling within the first 7 days of flight (147) were removed from the datasets analyzed to avoid confounding with Space Adaptation Syndrome. The final analysis was based on 1716 observations. For headache, 46 headaches were observed. CO2 level, age at launch, time inflight, and data source were all significantly associated with headache. In particular, for each 1 mmHg increase in CO2, the odds of a crewmember reporting a headache doubled. For vision changes, 29 reports of vision changes were observed. These observations were not found to be statistically associated with CO2 levels as analyzed. While the incidence of headache has was not high (~3%), headaches may be an indicator of underlying increases in intracranial pressure, which may result likely from the synergy between CO2‐induced cerebral vasodilatation and decreased venous drainage in microgravity. Vision changes were inconsistently reported and as a result did not align appropriately with the CO2 levels. Further analysis is needed. Our results support ongoing efforts to lower the CO2 exposure limits in spacecraft.

VanBaalen, M.↗
NASA NTRS2021

Astromaterial Curation and Research at NASA

Astromaterial sample return missions from other planetary bodies (e.g., the Moon, asteroids, the Sun) and astromaterial sample collection missions here on Earth (e.g., Antarctic Meteorites, Cosmic Dust) have been a vital part of NASA’s science vision since nearly its inception. Beginning with the Apollo missions to the Moon and extending to the recent successful sample collection by the OSIRIS-REx asteroid sample return mission, these astromaterials collections have been an invaluable resource to scientists and educators around the world. Sample studies continue to provide fundamental insight into how our solar system and its constituent bodies formed and evolved over the past 4.5 billion years. As evidence of their broad impact, there are over 19,141 samples on loan to 433 Principal Investigators in 24 countries [1]. As we plan for exploration missions through 2050, sample return missions will continue to play a vital role in NASA’s science vision. Returned samples truly are the gift that keeps on giving. Having the samples accessible on Earth allows new generations of scientists and new generations of instrumentation to pursue ever evolving scientific questions. For example, the Apollo samples were collected ~50 years ago, yet our views of how the Earth-Moon system formed, the role of volatiles in the early inner solar system, and even the positions of the gas giants in the outer solar system have changed dramatically as a result of Apollo sample analyses conducted very recently. Vital to the long-term viability of any sample return mission is the careful curation of the samples. Curatorial efforts need to begin early in the project lifecycle, not with the return of the samples, but at mission conception. The Astromaterials Acquisition and Curation Office at NASA Johnson Space Center is responsible for curating all of NASA’s current and future extraterrestrial samples. Looking at possible sample return missions over the next 35+ years [2], many samples would require curation efforts a step beyond current capabilities, e.g., cold or cryogenic curation, organically and biologically clean curation, curation of gases and ices, and curation of samples with extreme pressure, temperature, or redox requirements. During the lecture, we discuss the current curatorial efforts in JSC curation, as well as discoveries from the astromaterial research. [1] Zeigler, R. A. et al. (2017) Planetary Science Vision 2050 Workshop. [2] McCubbin F. M. et al. (2017) Planetary Science Vision 2050 Workshop.

astromaterial↗
NASA NTRS2022

IRIS: High-fidelity Perception Sensor Modeling for Closed-Loop Planetary Simulations

Perception plays a key role in autonomous and semi-autonomous planetary exploration vehicles. For instance, landers can use computer vision techniques for identifying safe landing locations, aerial vehicles use cameras as navigation sensors, and planetary rovers use them for localization and hazard detection. Engineering simulations of such systems requires the accurate modeling of perception and vision sensors for simulating autonomy scenarios. In addition, the modeling of sensors for landers, aerial and ground vehicles requires the ability to handle large and high-resolution terrains, the accurate modeling of illumination, hi-fidelity rendering via ray/path tracing and the inclusion of sensor characteristics. Vision sensor models strive to simulate sensor reality by using physics principles to model the interaction of light and objects. Furthermore, high frame rate performance is highly desirable for in-the-loop simulations involving vehicle dynamics and control software. In this paper we describe a new sensor modeling capability called Inter-planetary Rendering for Imaging and Sensors (IRIS) that meets these requirements for the real-time and high-fidelity simulation of vision sensors for planetary aerospace and robotics applications.

Elmquist, Asher↗
NASA NTRS2024

Exploration Systems Exterior Lighting Design Guidance

Humans are returning to the Moon — this time, to stay. NASA has selected a location that maximizes line-of-sight communication with Earth, solar visibility, and access to water ice: the Lunar South Pole (LSP). While the Sun is more consistently in the lunar sky at the poles, it never rises more than 7° above the horizon in the target landing regions. This harsh lighting environment--never experienced during the Apollo missions or in human spaceflight--presents an engineering challenge: Support and protect functional vision. The human vision system, which despite having a high-dynamic range, cannot see well into bright light and cannot adapt quickly from bright to dark or vice versa. The design of helmets, windows, and lighting solutions must work in a complementary fashion to achieve a system of lighting and functional vision support that enables crews to see into darkness while their eyes are light-adapted and see in bright light while still dark-adapted that protects their eyes from injury. This report brings together information and identifies gaps related to LSP Natural environment (topology, regolith, temperature, lighting, and so forth), NASA historical experience exploring the Moon, human vision capabilities and needs, exploration operations, simulation capabilities and needs (for design verification, training, mission planning, and so forth) and existing engineering, safety, medical and performance requirements related to support human exploration.

Simulation↗
DOE OSTI2022

Building Energy Modeling Enhancements to Identify Least-Cost Pathways to Net-Zero Carbon Homes: Preprint

Residential grid-interactive efficient buildings (GEBs) can utilize high levels of energy efficiency and demand flexibility to deliver value to occupants, the grid, and society. However, without the ability to analyze, design, and optimize residential GEBs there is a risk that homes will not realize their full potential value as efficient and dynamic resources, which could ultimately lead to higher than necessary energy costs for U.S. households and lower realization of potential energy efficiency and demand flexibility benefits such as increased convenience/automation, thermal comfort, durability, indoor air quality, and resilience. In 2018, the National Renewable Energy Laboratory (NREL) Residential Modeling Team developed a vision for an open source Residential GEB Analytics Platform built within DOE's EnergyPlus and OpenStudio modeling environment that would enable the design and optimization of residential GEBs, including the identification of least-cost pathways to highly energy-efficient and energy-flexible homes (e.g., net zero carbon homes). We created a detailed workplan for the development of new and enhanced residential GEB component-level models for EnergyPlus and OpenStudio needed to progress toward the vision for the analytics platform while delivering near-term benefits to industry. This paper 1) presents the vision for the platform, summarizing the workplan for residential GEB modeling enhancements; 2) highlights significant advancements that have been achieved between 2018 and 2022, including stochastic residential occupancy modeling, flexible water heater modeling, detailed lithium-ion stationary battery modeling, and realistic residential HVAC modeling; and 3) outlines ongoing efforts and next steps toward the full vision for the platform.

building energy modeling↗
DOE OSTI2012

Central Plateau Cleanup at DOE's Hanford Site - 12504

The discussion of Hanford's Central Plateau includes significant work in and around the center of the Hanford Site - located about 7 miles from the Columbia River. The Central Plateau is the area to which operations will be shrunk in 2015 when River Corridor cleanup is complete. This work includes retrieval and disposal of buried waste from miles of trenches; the cleanup and closure of massive processing canyons; the clean-out and demolition to 'slab on grade' of the high-hazard Plutonium Finishing Plant; installation of key groundwater treatment facilities to contain and shrink plumes of contaminated groundwater; demolition of all other unneeded facilities; and the completion of decisions about remaining Central Plateau waste sites. A stated goal of EM has been to shrink the footprint of active cleanup to less than 10 square miles by 2020. By the end of FY2011, Hanford will have reduced the active footprint of cleanup by 64 percent exceeding the goal of 49 percent. By 2015, Hanford will reduce the active footprint of cleanup by more than 90 percent. The remaining footprint reduction will occur between 2015 and 2020. The Central Plateau is a 75-square-mile region near the center of the Hanford Site including the area designated in the Hanford Comprehensive Land Use Plan Environmental Impact Statement (DOE 1999) and Record of Decision (64 FR 61615) as the Industrial-Exclusive Area, a rectangular area of about 20 square miles in the center of the Central Plateau. The Industrial-Exclusive Area contains the 200 East and 200 West Areas that have been used primarily for Hanford's nuclear fuel processing and waste management and disposal activities. The Central Plateau also encompasses the 200 Area CERCLA National Priorities List site. The Central Plateau has a large physical inventory of chemical processing and support facilities, tank systems, liquid and solid waste disposal and storage facilities, utility systems, administrative facilities, and groundwater monitoring wells. As a companion to the Hanford Site Cleanup Completion Framework document, DOE issued its draft Central Plateau Cleanup Completion Strategy in September 2009 to provide an outline of DOE's vision for completion of cleanup activities across the Central Plateau. As major elements of the Hanford cleanup along the Columbia River Corridor near completion, DOE believed it appropriate to articulate the agency vision for the remainder of the cleanup mission. The Central Plateau Cleanup Completion Strategy and the Hanford Site Cleanup Completion Framework were provided to the regulatory community, the Tribal Nations, political leaders, the public, and Hanford stakeholders to promote dialogue on Hanford's future. The Central Plateau Cleanup Completion Strategy describes DOE's vision for completion of Central Plateau cleanup and outlines the decisions needed to achieve the vision. The Central Plateau strategy involves steps to: (1) contain and remediate contaminated groundwater, (2) implement a geographic cleanup approach that guides remedy selection from a plateau-wide perspective, (3) evaluate and deploy viable treatment methods for deep vadose contamination to provide long-term protection of the groundwater, and (4) conduct essential waste management operations in coordination with cleanup actions. The strategy will also help optimize Central Plateau readiness to use funding when it is available upon completion of River Corridor cleanup projects. One aspect of the Central Plateau strategy is to put in place the process to identify the final footprint for permanent waste management and containment of residual contamination within the 20-square-mile Industrial-Exclusive Area. The final footprint identified for permanent waste management and containment of residual contamination should be as small as practical and remain under federal ownership and control for as long as a potential hazard exists. Outside the final footprint, the remainder of the Central Plateau will be available for other uses consistent with the Hanford Comprehensive Land-Use Plan (DOE 1999), while maintained under federal ownership and control. (author)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2013

Meningioma Causing Visual Impairment: Outcomes and Toxicity After Intensity Modulated Radiation Therapy

Purpose: To evaluate ophthalmologic outcomes and toxicity of intensity modulated radiation therapy (IMRT) in patients with meningiomas causing visual deficits. Methods and Materials: A prospective observational study with formal ophthalmologic and clinical assessment of 30 consecutive cases of meningioma affecting vision treated with IMRT from 2007 to 2011. Prescriptions were 50.4 Gy to mean target dose in 28 daily fractions. The median follow-up time was 28 months. Twenty-six meningiomas affected the anterior visual pathway (including 3 optic nerve sheath meningiomas); 4 were posterior to the chiasm. Results: Vision improved objectively in 12 patients (40%). Improvements were in visual field (5/16 patients), color vision (4/9 patients), acuity (1/15 patients), extraocular movements (3/11 patients), ptosis (1/5 patients), and proptosis (2/6 patients). No predictors of clinical response were found. Two patients had minor reductions in tumor dimensions on magnetic resonance imaging, 1 patient had radiological progression, and the other patients were stable. One patient experienced grade 2 keratitis, 1 patient had a minor visual field loss, and 5 patients had grade 1 dry eye. Conclusion: IMRT is an effective method for treating meningiomas causing ophthalmologic deficits, and toxicity is minimal. Thorough ophthalmologic assessment is important because clinical responses often occur in the absence of radiological change.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

van der Waals Semiconductor Empowered Vertical Color Sensor

We report biomimetic artificial vision is receiving significant attention nowadays, particularly for the development of neuromorphic electronic devices, artificial intelligence, and microrobotics. Nevertheless, color recognition, the most critical vision function, is missed in the current research due to the difficulty of downscaling of the prevailing color sensing devices. Conventional color sensors typically adopt a lateral color sensing channel layout and consume a large amount of physical space, whereas compact designs suffer from an unsatisfactory color detection accuracy. In this work, we report a van der Waals semiconductor-empowered vertical color sensing structure with the emphasis on compact device profile and precise color recognition capability. More attractive, we endow color sensor hardware with the function of chromatic aberration correction, which can simplify the design of an optical lens system and, in turn, further downscales the artificial vision systems. Also, the dimension of a multiple pixel prototype device in our study confirms the scalability and practical potentials of our developed device architecture toward the above applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Managing the Performance/Error Tradeoff of Floating-point Intensive Applications

Modern embedded systems are becoming more reliant on real-valued arithmetic as they employ mathematically complex vision algorithms and sensor signal processing. Double-precision floating point is the most commonly used precision in computer vision algorithm implementations. A single-precision floating point can provide a performance boost due to less memory transfers, less cache occupancy, and relatively faster mathematical operations on some architectures. However, adopting it can result in loss of accuracy. Identifying which parts of the program can run in single-precision floating point with low impact on error is a manual and tedious process. In this paper, we propose an automatic approach to identify parts of the program that have a low impact on error using shadow-value analysis. Our approach provides the user with a performance/error tradeoff, using which the user can decide how much accuracy can be sacrificed in return for performance improvement. We illustrate the impact of the approach using a well known implementation of Apriltag detection used in robotics vision. In conclusion, we demonstrate that an average 1.3x speedup can be achieved with no impact on tag detection, and a 1.7x speedup with only 4% false negatives.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Intelligent Process Visualization through Nuclear Operation Process Modeling, Reasoning, and Object Detection from Field Videos (Final Report)

This report is a deliverable for the “Final Report” task of DOE NEET Project 19-16790, "Context-Aware Safety Information Display for Nuclear Field Workers." This project's overall goal is to test the hypothesis that integrating computer vision and process reasoning methods will enable proactive visualization of the safe operation and maintenance processes of Nuclear Power Plants (NPP) for field workers. Augmented Reality (AR) glasses adopting such proactive safety information visualization techniques can significantly increase personnel safety and reduce the NPP’s operating costs. The current practice of monitoring NPPs requires workers to switch between digital models, data, and physical workspaces in identifying relevant but potentially occluded objects and in assessing the risks of operation and maintenance processes. On the other hand, frequently changed field conditions require field workers to report to supervisors for real-time guidance. Such guidance is essential to ensure that changing conditions will not invalidate or endanger the work order and other ongoing processes that may jeopardize NPP operations. Additionally, incorrect recognition of equipment objects can result in communication errors and safety problems. AR techniques can assist engineers in viewing the physical workspaces with objects labeled with detailed operation procedures and safety reminders during field operations. The project team developed an “Intelligent Context-Aware Safety Information Display” (ICAD) for supporting Nuclear Power Plant (NPP) field workers in achieving safe and efficient execution of a series of operational tasks in uncertain and changing workspaces of an NPP. Before designing the ICAD-AR prototype, the project team synthesized NPP operational knowledge models through literature review studies, surveys, interviews with domain experts, and knowledge modeling. The project team conducted an extensive study of the operational procedures of various NPPs, and digital technologies that can support the safe and efficient execution of those procedures in different NPP operational contexts. This literature review helped the project team conduct surveys and interviews with nuclear engineers and field workers to identify three categories of information. The NPP knowledge modeling efforts reveal that the three categories of information identified have different levels of importance in a typical procedure of carrying out a series of tasks to achieve a specific NPP operation goal (e.g., shutdown, mode changes). These three categories of information include 1) Workspace dynamics – the changing spatial arrangements of workspaces, tools, protection equipment, and supporting materials, 2) Workflow prognostics – the dynamic dependencies between different parts of an NPP that functionally support and influence each other in terms of safety and efficiency, and 3) Hazards – objects and spaces that contain hazardous materials or physical conditions that can pose risks to workers or mechanical systems. The project team has profiled the importance levels of these categories of information into a knowledge model. This knowledge model specifies what types of information are more critical for a given task in a given workspace so that computers can automatically identify critical objects and sensors in a scene for delivering context-ware safety information to field workers through AR devices. Significant research development of this project results in technical research outcomes and a prototyping system that illustrates the technical feasibility of establishing an ICAD-AR system supporting the proactive safety information display for nuclear field workers. This final report summarizes the project team’s technological achievements in the past three years. Overall, the project team completed the development and integration of five techniques into a prototype ICAD Augmented Reality (ICAD-AR) system and demonstrated the developed system’s real-time execution in a mechanical room. The project team completed the analysis of using this prototype in other types of workspaces based on 3D image data and digital design models collected from two additional workspaces (a water treatment plant and a flow loop training facility). The integrated techniques include 1) Natural Language Processing (NLP) algorithms supporting the generation and updates of nuclear fieldwork process models based on text analysis of work packages and operation manuals; 2) sensor log analysis for predicting control actions in given sensor reading contexts; 3) computer vision algorithms for automatic localization and navigation of workers; 4) object detection algorithms for identifying task-related objects and correlated sensors for safety checking; 5) AR technique as a platform for supporting the integration. The testing results of these five techniques have shown that 1) the sensor log analysis model can predict the next control action with an accuracy of 0.883; 2) the trained natural language processing model can extract more than 80% of the critical information from paper-based procedures (PBPs); 3) the navigation algorithm with the integration of Visual Inertial Odometry (VIO) and Non-Recursive Bayesian Filter methods make operator’s trajectory estimation resilient to drift error; 4) the computer vision algorithm can detect task-specific and safety-critical objects with an average accuracy of 95.3%. The project team used work procedures collected from a flow loop training facility and two datasets collected from two mechanical rooms simulating the workspaces of NPPs to demonstrate the technical capabilities of the developed ICAD-AR prototype. The demonstration validated the technical feasibility of establishing the ICAD-AR system for nuclear field workers and identified the challenges in 1) automatic text analysis of work packages; 2) use of limited samples of sensor logs for predicting the proper timings of control actions; 3) reliably tracking workers and their task progress in mechanical rooms with many similar objects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Demonstration and Evaluation of the Human-Technology Integration Guidance for Plant Modernization

The significance of nuclear power in its role producing carbon-free electricity to the U.S. cannot be overstated. However, with changes in the energy market coupled with changes in incentives given to certain resources like solar and wind, the operating and maintenance costs for these sources have seen a significant reduction, which has consequently negatively impacted the economic viability of the existing U.S. nuclear power plant fleet. Digital instrumentation and control (I&C) and control room modernization is a major critical work domain to reduce operating and maintenance costs. Existing nuclear power plants are commonly configured with mostly legacy analog I&C as well as isolated pockets of digital I&C (a plant process computer, digital recorders, etc.). One challenge with this analog I&C is that replacement parts are becoming prohibitively more expensive and difficult to obtain. Moreover, a significant challenge with the existing analog I&C is that the way in which plants are currently operated and maintained is no longer competitive with other electricity generating sources, like natural gas, where advanced digital I&C technologies are commonplace. This gap between the waynuclear power plants are operated compared to other electricity generating sources significantly challenges the economic viability of the nuclear industry. Indeed, digital I&C systems can fundamentally change the way the plant is operated (i.e., the concept of operation). The introduction of digital I&C technologies offers a wealth of benefits to the nuclear industry. However, it is important to emphasize that, to realize these benefits, a careful understanding of how to integrate technology in a collaborative way that leverages the capabilities of people and technologies is necessary. Human-technology integration applies human factors engineering methods and tools to ensure the safe and reliable use of these technologies while ensuring that the inherent features of the technologies that provide economic value are not missed. The scope of this work documents the demonstration of the recently developed human and technology integration methodology, as applied to developing a new vision and concept of operations for a major U.S. nuclear power plant fleet. This report focuses on the methodological aspects of developing a vision and concept of operations. This report shares the tools, activities, and lessons learned during a modernization currently underway for industry as a whole to consider when planning any significant digital modification and developing a new vision and concept of operations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Enterprise: Exploration of Concepts, Perspectives and Implications for Systems Engineering

The purpose of this paper is to explore the concept of ‘enterprise’ in the context of Systems Engineering (SE). The term ‘enterprise’ has been used extensively to generally describe large complex entities that have an extensive scope of operations. However, a deeper examination of ‘enterprise’ significance for SE can provide insights as our challenges continue with increasingly complex, uncertain, ambiguous, and integrated entities struggling to thrive in the future. The paper explores three central topics. First, the concept of enterprise is introduced as a central aspect of the future focus for SE, as recognized in the INCOSE SE Vision 2035. Second, a more detailed examination of the enterprise concept is developed in relationship to SE. The thrust of this examination is to understand the nature and role of ‘enterprise’ across a broad spectrum of literature and knowledge, ultimately providing a more informed perspective of enterprise for SE. As part of this exploration, a bibliometric analysis of the term ‘enterprise’ is performed. This exploration extracts key themes (clusters) in the ‘enterprise’ literature. Third, challenges for further development and inculcation of ‘enterprise’ within the SE discipline and support for realization of the SE 2035 Vision are suggested. These challenges point out the need to ‘think differently’ about ‘enterprise’ within the SE context. ‘Enterprise’ is proposed as a central, albeit different, perspective for the SE discipline. Finally, the paper closes with a first–generation perspective for ‘enterprise’ in pursuit of the SE Vision 2035.

42 ENGINEERING↗