Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Visual Programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Interactive orbital proximity operations planning system

An interactive graphical proximity operations planning system was developed, which allows on-site design of efficient, complex, multiburn maneuvers in a dynamic multispacecraft environment. Maneuvering takes place in and out of the orbital plane. The difficulty in planning such missions results from the unusual and counterintuitive character of orbital dynamics and complex time-varying operational constraints. This difficulty is greatly overcome by visualizing the relative trajectories and the relevant constraints in an easily interpretable graphical format, which provides the operator with immediate feedback on design actions. The display shows a perspective bird's-eye view of a Space Station and co-orbiting spacecraft on the background of the Station's orbital plane. The operator has control over the two modes of operation: a viewing system mode, which enables the exporation of the spatial situation about the Space Station and thus the ability to choose and zoom in on areas of interest; and a trajectory design mode, which allows the interactive editing of a series of way points and maneuvering burns to obtain a trajectory that complies with all operational constraints. A first version of this display was completed. An experimental program is planned in which operators will carry out a series of design missions which vary in complexity and constraints.

Grunwald, Arthur J.↗

Intelligent Systems and Advanced User Interfaces for Design, Operation, and Maintenance of Command Management Systems

Historically Command Management Systems (CMS) have been large, expensive, spacecraft-specific software systems that were costly to build, operate, and maintain. Current and emerging hardware, software, and user interface technologies may offer an opportunity to facilitate the initial formulation and design of a spacecraft-specific CMS as well as a to develop a more generic or a set of core components for CMS systems. Current MOC (mission operations center) hardware and software include Unix workstations, the C/C++ and Java programming languages, and X and Java window interfaces representations. This configuration provides the power and flexibility to support sophisticated systems and intelligent user interfaces that exploit state-of-the-art technologies in human-machine systems engineering, decision making, artificial intelligence, and software engineering. One of the goals of this research is to explore the extent to which technologies developed in the research laboratory can be productively applied in a complex system such as spacecraft command management. Initial examination of some of the issues in CMS design and operation suggests that application of technologies such as intelligent planning, case-based reasoning, design and analysis tools from a human-machine systems engineering point of view (e.g., operator and designer models) and human-computer interaction tools, (e.g., graphics, visualization, and animation), may provide significant savings in the design, operation, and maintenance of a spacecraft-specific CMS as well as continuity for CMS design and development across spacecraft with varying needs. The savings in this case is in software reuse at all stages of the software engineering process.

Mitchell, Christine M.↗

Computer Programming Resources 2018

The document is a compilation of Computer Programming resources. It is geared toward front-end and back-end web development. It specializes on an ongoing project to create a website for the Safety and Mission Assurance Directorate. The Quality Assurance System (QAS) is intended to improve the overall quality and efficiency of communication among NASA Quality Assurance Engineers and Contractors. The use of QAS software will be limited to NASA Kennedy Space Center and Contractors. It is accessible through the KSC network.

Confluence↗

Mass and Reliability System (MaRS)

The Safety and Mission Assurance (S&MA) Directorate is responsible for mitigating risk, providing system safety, and lowering risk for space programs from ground to space. The S&MA is divided into 4 divisions: The Space Exploration Division (NC), the International Space Station Division (NE), the Safety & Test Operations Division (NS), and the Quality and Flight Equipment Division (NT). The interns, myself and Arun Aruljothi, will be working with the Risk & Reliability Analysis Branch under the NC Division's. The mission of this division is to identify, characterize, diminish, and communicate risk by implementing an efficient and effective assurance model. The team utilizes Reliability and Maintainability (R&M) and Probabilistic Risk Assessment (PRA) to ensure decisions concerning risks are informed, vehicles are safe and reliable, and program/project requirements are realistic and realized. This project pertains to the Orion mission, so it is geared toward a long duration Human Space Flight Program(s). For space missions, payload is a critical concept; balancing what hardware can be replaced by components verse by Orbital Replacement Units (ORU) or subassemblies is key. For this effort a database was created that combines mass and reliability data, called Mass and Reliability System or MaRS. The U.S. International Space Station (ISS) components are used as reference parts in the MaRS database. Using ISS components as a platform is beneficial because of the historical context and the environment similarities to a space flight mission. MaRS uses a combination of systems: International Space Station PART for failure data, Vehicle Master Database (VMDB) for ORU & components, Maintenance & Analysis Data Set (MADS) for operation hours and other pertinent data, & Hardware History Retrieval System (HHRS) for unit weights. MaRS is populated using a Visual Basic Application. Once populated, the excel spreadsheet is comprised of information on ISS components including: operation hours, random/nonrandom failures, software/hardware failures, quantity, orbital replaceable units (ORU), date of placement, unit weight, frequency of part, etc. The motivation for creating such a database will be the development of a mass/reliability parametric model to estimate mass required for replacement parts. Once complete, engineers working on future space flight missions will have access a mean time to failures and on parts along with their mass, this will be used to make proper decisions for long duration space flight missions

Barnes, Sarah↗

Retinal ganglion cell projections to the hamster suprachiasmatic nucleus, intergeniculate leaflet, and visual midbrain: bifurcation and melanopsin immunoreactivity

The circadian clock in the suprachiasmatic nucleus (SCN) receives direct retinal input via the retinohypothalamic tract (RHT), and the retinal ganglion cells contributing to this projection may be specialized with respect to direct regulation of the circadian clock. However, some ganglion cells forming the RHT bifurcate, sending axon collaterals to the intergeniculate leaflet (IGL) through which light has secondary access to the circadian clock. The present studies provide a more extensive examination of ganglion cell bifurcation and evaluate whether ganglion cells projecting to several subcortical visual nuclei contain melanopsin, a putative ganglion cell photopigment. The results showed that retinal ganglion cells projecting to the SCN send collaterals to the IGL, olivary pretectal nucleus, and superior colliculus, among other places. Melanopsin-immunoreactive (IR) ganglion cells are present in the hamster retina, and some of these cells project to the SCN, IGL, olivary pretectal nucleus, or superior colliculus. Triple-label analysis showed that melanopsin-IR cells bifurcate and project bilaterally to each SCN, but not to the other visual nuclei evaluated. The melanopsin-IR cells have photoreceptive characteristics optimal for circadian rhythm regulation. However, the presence of moderately widespread bifurcation among ganglion cells projecting to the SCN, and projection by melanopsin-IR cells to locations distinct from the SCN and without known rhythm function, suggest that this ganglion cell type is generalized, rather than specialized, with respect to the conveyance of photic information to the brain. Copyright 2003 Wiley-Liss, Inc.

NASA Discipline Neuroscience↗

Flight Test of a Head-Worn Display as an Equivalent-HUD for Terminal Operations

Research, development, test, and evaluation of flight deck interface technologies is being conducted by NASA to proactively identify, develop, and mature tools, methods, and technologies for improving overall aircraft safety of new and legacy vehicles operating in the Next Generation Air Transportation System (NextGen). Under NASA's Aviation Safety Program, one specific area of research is the use of small Head-Worn Displays (HWDs) as a potential equivalent display to a Head-up Display (HUD). Title 14 of the US CFR 91.175 describes a possible operational credit which can be obtained with airplane equipage of a HUD or an "equivalent"' display combined with Enhanced Vision (EV). A successful HWD implementation may provide the same safety and operational benefits as current HUD-equipped aircraft but for significantly more aircraft in which HUD installation is neither practical nor possible. A flight test was conducted to evaluate if the HWD, coupled with a head-tracker, can provide an equivalent display to a HUD. Approach and taxi testing was performed on-board NASA's experimental King Air aircraft in various visual conditions. Preliminary quantitative results indicate the HWD tested provided equivalent HUD performance, however operational issues were uncovered. The HWD showed significant potential as all of the pilots liked the increased situation awareness attributable to the HWD's unique capability of unlimited field-of-regard.

Shelton, K. J.↗

From Auroras to Sea Ice: Views From the International Space Station and Plans for International Polar Year

For more than 40 years astronauts have been observing Earth, taking photographs or digital images from their spacecraft. Today, a robust program of observation from the International Space Station (ISS) has yielded hundreds of thousands of images of the Earth s surface collected since 2001. Seeing Earth through the eyes of an astronaut is exciting to the general public, and the images are popular in classrooms. Because the ISS has an orbital inclination of 51.6 degrees (the north-south limits of the orbit are at 51.6 degrees latitude), high latitude observations are common. Some of the most striking images collected include views of polar phenomena. Astronauts routinely pass above brilliant red and green aurora; view high, wispy clouds at the top of the atmosphere; or look down on glaciers and floating ice rafts. These images, framed and captured by humans, are easily interpreted by students and teachers. Astronaut observations provide a way to visualize complicated polar phenomena and communicate about them to students of all ages. Over the next two years, astronauts aboard the ISS will formally focus their observations on polar phenomena as participants in the International Polar Year (IPY). Imagery acquisition from the ISS will be coordinated with other IPY scientists staging studies and field campaigns on the ground. The imagery collected from the ISS will be cataloged and served on NASA s web-based database of images, http://eol.jsc.nasa.gov . The website allows investigators, students and teachers to search through the imagery, assemble image datasets, and download the imagery and the metadata. We display some of the most spectacular examples of polar imagery and demonstrate NASA s database of astronaut images of Earth.

Evans, Cynthia A.↗

Survey and Chase: A New Method of Observations For The Michigan Orbital Debris Survey Telescope (MODEST)

For more than 40 years astronauts have been observing Earth, taking photographs or digital images from their spacecraft. Today, a robust program of observation from the International Space Station (ISS) has yielded hundreds of thousands of images of the Earth s surface collected since 2001. Seeing Earth through the eyes of an astronaut is exciting to the general public, and the images are popular in classrooms. Because the ISS has an orbital inclination of 51.6 degrees (the north-south limits of the orbit are at 51.6 degrees latitude), high latitude observations are common. Some of the most striking images collected include views of polar phenomena. Astronauts routinely pass above brilliant red and green aurora; view high, wispy clouds at the top of the atmosphere; or look down on glaciers and floating ice rafts. These images, framed and captured by humans, are easily interpreted by students and teachers. Astronaut observations provide a way to visualize complicated polar phenomena and communicate about them to students of all ages. Over the next two years, astronauts aboard the ISS will formally focus their observations on polar phenomena as participants in the International Polar Year (IPY). Imagery acquisition from the ISS will be coordinated with other IPY scientists staging studies and field campaigns on the ground. The imagery collected from the ISS will be cataloged and served on NASA s web-based database of images, http://eol.jsc.nasa.gov . The website allows investigators, students and teachers to search through the imagery, assemble image datasets, and download the imagery and the metadata. We display some of the most spectacular examples of polar imagery and demonstrate NASA s database of astronaut images of Earth.

Abercromby, Kira J.↗

Visualizing Geospatial Data through ESRI Story Maps for Earth Science Education: Lessons Learned from My NASA Data

For 20 years My NASA Data (MND) has curated NASA Earth science data and provided the data to educators in engaging learner-centered resources. MND has recently featured story maps as an innovative way to engage students in NASA Earth data. A story map is a cloud-based lesson that engages the learner in interactive geospatial maps using NASA data, and other multimedia content, text, and tasks that can be seamlessly incorporated in classroom instruction. This immersive technology eliminates the need for the user to move among tricky interfaces to access and visualize Earth science data, and no special software is required to be downloaded. Each story map integrates data from different NASA satellite missions, retrieved from Distributed Active Archive Centers (DAACs). Story maps also employ data analysis tools, such as time series options and swipe tools that allow learners to view and analyze relationships between scientific variables. MND has produced 25 story map lesson plans on the topics of air quality, the urban heat island effect, Earth’s energy budget, phytoplankton distribution, hurricane formation, solar eclipses, ocean circulation patterns, sea ice extent, and volcanic eruptions. Nine of them are extended story maps and written in the 5E format, which is internationally recognized as best practice based on how children learn science. Each story map resource is developed by the MND team featuring a GIS programming specialist, a lead scientist, and educational specialist/s to ensure the context, content, and methods are scientifically and educationally sound. The MND story maps are written for middle and high school science teachers and students as they connect with the Earth Systems Science phenomena featured in the Next Generation Science Standards. Each story map includes supporting resources for smooth integration in the classroom. During Fiscal Year 2023, The My NASA Data website received over 100,000 story map engagements during. These metrics highlight the interest in story maps as an Earth Science educational resource.

Desiray Wilson↗

Stereoscopic Height and Wind Retrievals for Aerosol Plumes with the MISR INteractive eXplorer (MINX)

The Multi-angle Imaging SpectroRadiometer (MISR) instrument aboard the Terra satellite acquires imagery at 275-m resolution at nine angles ranging from 0deg (nadir) to 70deg off-nadir. This multi-angle capability facilitates the stereoscopic retrieval of heights and motion vectors for clouds and aerosol plumes. MISR's operational stereo product uses this capability to retrieve cloud heights and winds for every satellite orbit, yielding global coverage every nine days. The MISR INteractive eXplorer (MINX) visualization and analysis tool complements the operational stereo product by providing users the ability to retrieve heights and winds locally for detailed studies of smoke, dust and volcanic ash plumes, as well as clouds, at higher spatial resolution and with greater precision than is possible with the operational product or with other space-based, passive, remote sensing instruments. This ability to investigate plume geometry and dynamics is becoming increasingly important as climate and air quality studies require greater knowledge about the injection of aerosols and the location of clouds within the atmosphere. MINX incorporates features that allow users to customize their stereo retrievals for optimum results under varying aerosol and underlying surface conditions. This paper discusses the stereo retrieval algorithms and retrieval options in MINX, and provides appropriate examples to explain how the program can be used to achieve the best results.

MISR↗

Calibration of Post-AGB Supergiants as Standard Extragalactic Candles for HST

This report summarizes activities carried out with support from the NASA Ultraviolet, Visible, and Gravitational Astrophysics Research and Analysis Program. The aim of the program is to calibrate the absolute magnitudes of post-asymptotic-giant-branch (post-AGB or PAGB) stars, which we believe will be an excellent new "standard candle" for measuring extragalactic distances. The reason for this belief is that in old populations, the stars that are evolving through the PAGB region of the HR (Hertzsprung-Russell) diagram arise from only a single main-sequence turnoff mass. In addition, the theoretical PAGB evolutionary tracks show that they evolve through this region at constant luminosity; hence the PAGB stars should have an extremely narrow luminosity function. Moreover, as the PAGB stars evolve through spectral types F and A (en route from the AGB to hot stellar remnants and white dwarfs), they have the highest luminosities attained by old stars (both bolometrically and in the visual band). Finally, the PAGB stars of these spectral types are very easily identified, due to their large Balmer jumps, which are due to their very low surface gravities.

Bond, Howard E.↗

Large Aperture Scanning Lidar Based on Holographic Optical Elements

Lidar remote sensing instruments can make a significant contribution to satisfying many of the required measurements of atmospheric and surface parameters for future spaceborne platforms, including topographic altimeters, atmospheric profiles of, wind, humidity, temperature, trace molecules, aerosols, and clouds. It is highly desirable to have wide measurement swaths for rapid coverage rather than just the narrow ribbon of data that is obtained with a nadir only observation. For most applications global coverage is required, and for wind measurements scanning or pointing is required in order to retrieve the full 3-D wind vector from multiple line-of-sight Doppler measurements. Conventional lidar receivers make up a substantial portion of the instrument's size and weight. Wide angle scanning typically requires a large scanning mirror in front of the receiver telescope, or pointing the entire telescope and aft optics assembly, Either of these methods entails the use of large bearings, motors, gearing and their associated electronics. Spaceborne instruments also need reaction wheels to counter the torque applied to the spacecraft by these motions. NASA has developed simplified conical scanning telescopes using Holographic Optical Elements (HOEs) to reduce the size, mass, angular momentum, and cost of scanning lidar systems. NASA has developed two operating lidar systems based on 40 cm diameter HOEs. The first such system, named Prototype Holographic Atmospheric Scanner for Environmental Remote Sensing (PHASERS) was a joint development between NASA Goddard Space Flight Center (GSFC) and the University of Maryland College Park. PHASERS is based on a reflection HOE for use at the doubled Nd:YAG laser wavelength of 532 nm and has recently undergone a number of design changes in a collaborative effort between GSFC and Saint Anselm College in New Hampshire. The next step was to develop IR transmission HOEs for use with the Nd:YAG fundamental in the Holographic Airborne Rotating Lidar Instrument Experiment (HARLIE). The HOE spins like a compact disk in a large ring ball bearing. In an aircraft the HOE faces down, looking out through a window at an angle of 45 degrees off-nadir. The HOE diffracts 85% of the incident 532 nm light into a 160 micron spot at a focal length of 1 meter. HARLIE is a field deployable lidar measuring aerosol, cloud, and boundary layer backscatter for atmospheric research. It has flown several times and is also used from a ground-based trailer in an upward-looking mode. The HOE generates a 45 degree conical scan pattern by rotating at speeds up to 30 rpm. Like PHASERS, the HOE in HARLIE serves both as the laser collimating lens as well as the receiver telescope primary optic. The telescope is coupled to the receiver package via fiber optic. The transmitter is a diode pumped Nd:YAG laser operating at 1064 nm, delivering 1 mJ pulses at a 5 KHz rep-rate. The receiver has a 200 microradian field-of-view and a 0.5 nm optical bandpass. The photon counting data system utilizes a single Geiger-mode silicon avalanche photodiode detector, This new technology has also presented us with new data visualization challenges as well as new measurement techniques. The backscatter data obtained from a stationary (i.e. ground-based) scanning HOE lidar is on the surface of a cone, which when viewed over many consecutive scans can reveal atmospheric motions on this surface over time as the atmosphere advects over the site. In a moving platform such as an airplane or satellite, the data from consecutive scans cover different areas under the flight path, revealing atmospheric structure in 3-dimensions. An example of a visualization of HARLIE ground-based data is presented, showing aerosol backscatter on a 90 degree conical surface generated from one 360 degree scan of the lidar during the HOLO-1 field campaign on the afternoon of 10 March 1999. Higher backscatter levels are rendered as lighter signal against a dark background. Breaking Kelvin-Helmholtz waves are evident on the north side of the scan at an altitude of 10-11 km. Time series of successive scans made at regular intervals render unique views of atmospheric motions, from which vertical profiles of atmospheric wind vectors can be obtained using a unique data analysis approach. Wind vectors obtained from the lidar were compared with co-located radiosonde wind profiles during an intensive operating period in September-October 2000 at the Atmospheric Radiation Measurement Program's Southern Great Plains Central Facility.

Schwemmer, Geary K.↗

Flight Simulator Evaluation of Display Media Devices for Synthetic Vision Concepts

The Synthetic Vision Systems (SVS) Project of the National Aeronautics and Space Administration's (NASA) Aviation Safety Program (AvSP) is striving to eliminate poor visibility as a causal factor in aircraft accidents as well as enhance operational capabilities of all aircraft. To accomplish these safety and capacity improvements, the SVS concept is designed to provide a clear view of the world around the aircraft through the display of computer-generated imagery derived from an onboard database of terrain, obstacle, and airport information. Display media devices with which to implement SVS technology that have been evaluated so far within the Project include fixed field of view head up displays and head down Primary Flight Displays with pilot-selectable field of view. A simulation experiment was conducted comparing these display devices to a fixed field of view, unlimited field of regard, full color Helmet-Mounted Display system. Subject pilots flew a visual circling maneuver in IMC at a terrain-challenged airport. The data collected for this experiment is compared to past SVS research studies.

Arthur, J. J., III↗

Three-dimensional organization of vestibular-related eye movements to off-vertical axis rotation and linear translation in pigeons

During linear accelerations, compensatory reflexes should continually occur in order to maintain objects of visual interest as stable images on the retina. In the present study, the three-dimensional organization of the vestibulo-ocular reflex in pigeons was quantitatively examined during linear accelerations produced by constant velocity off-vertical axis yaw rotations and translational motion in darkness. With off-vertical axis rotations, sinusoidally modulated eye-position and velocity responses were observed in all three components, with the vertical and torsional eye movements predominating the response. Peak torsional and vertical eye positions occurred when the head was oriented with the lateral visual axis of the right eye directed orthogonal to or aligned with the gravity vector, respectively. No steady-state horizontal nystagmus was obtained with any of the rotational velocities (8-58 degrees /s) tested. During translational motion, delivered along or perpendicular to the lateral visual axis, vertical and torsional eye movements were elicited. No significant horizontal eye movements were observed during lateral translation at frequencies up to 3 Hz. These responses suggest that, in pigeons, all linear accelerations generate eye movements that are compensatory to the direction of actual or perceived tilt of the head relative to gravity. In contrast, no translational horizontal eye movements, which are known to be compensatory to lateral translational motion in primates, were observed under the present experimental conditions.

NASA Discipline Neuroscience↗

Access Control of Web- and Java-Based Applications

Cybersecurity has become a great concern as threats of service interruption, unauthorized access, stealing and altering of information, and spreading of viruses have become more prevalent and serious. Application layer access control of applications is a critical component in the overall security solution that also includes encryption, firewalls, virtual private networks, antivirus, and intrusion detection. An access control solution, based on an open-source access manager augmented with custom software components, was developed to provide protection to both Web-based and Javabased client and server applications. The DISA Security Service (DISA-SS) provides common access control capabilities for AMMOS software applications through a set of application programming interfaces (APIs) and network- accessible security services for authentication, single sign-on, authorization checking, and authorization policy management. The OpenAM access management technology designed for Web applications can be extended to meet the needs of Java thick clients and stand alone servers that are commonly used in the JPL AMMOS environment. The DISA-SS reusable components have greatly reduced the effort for each AMMOS subsystem to develop its own access control strategy. The novelty of this work is that it leverages an open-source access management product that was designed for Webbased applications to provide access control for Java thick clients and Java standalone servers. Thick clients and standalone servers are still commonly used in businesses and government, especially for applications that require rich graphical user interfaces and high-performance visualization that cannot be met by thin clients running on Web browsers

Tso, Kam S.↗

Initial Sensorimotor and Cardiovascular Data Acquired from Soyuz Landings: Establishing a Functional Performance Recovery Time Constant

INTRODUCTION Testing of crew responses following long-duration flights has not been previously possible until a minimum of more than 24 hours after landing. As a result, it has not been possible to determine the trend of the early recovery process, nor has it been possible to accurately assess the full impact of the decrements associated with long-duration flight. To overcome these limitations, both the Russian and U.S. programs have implemented joint testing at the Soyuz landing site. This International Space Station research effort has been identified as the functional Field Test, and represents data collect on NASA, Russian, European Space Agency, and Japanese Aerospace Exploration Agency crews. RESEARCH The primary goal of this research is to determine functional abilities associated with long-duration space flight crews beginning as soon after landing as possible on the day of landing (typically within 1 to 1.5 hours). This goal has both sensorimotor and cardiovascular elements. To date, a total of 15 subjects have participated in a 'pilot' version of the full 'field test'. The full version of the 'field test' will assess functional sensorimotor measurements included hand/eye coordination, standing from a seated position (sit-to-stand), walking normally without falling, measurement of dynamic visual acuity, discriminating different forces generated with the hands (both strength and ability to judge just noticeable differences of force), standing from a prone position, coordinated walking involving tandem heel-to-toe placement (tested with eyes both closed and open), walking normally while avoiding obstacles of differing heights, and determining postural ataxia while standing (measurement of quiet stance). Sensorimotor performance has been obtained using video records, and data from body worn inertial sensors. The cardiovascular portion of the investigation has measured blood pressure and heart rate during a timed stand test in conjunction with postural ataxia testing (quiet stance sway) as well as cardiovascular responses during sensorimotor testing on all of the above measures. We have also collected motion sickness data associated with each of the postflight tests. When possible rudimentary cerebellar assessment was undertaken. In addition to the immediate post-landing collection of data, postflight data has been acquired twice more within 24 hours after landing and measurements continue until sensorimotor and cardiovascular responses have returned to preflight normative values (approximately 60 days postflight). SUMMARY The level of functional deficit observed in the crew tested to date is more severe than expected, clearly triggered by the acquisition of gravity loads immediately after landing when the demands for crew intervention in response to emergency operations will be greatest. Measureable performance parameters such as ability to perform a seat egress, recover from a fall or the ability to see clearly when walking, and related physiologic data (orthostatic responses) are required to provide an evidence base for characterizing programmatic risks and the degree of variability among crewmembers for exploration missions where the crew will be unassisted after landing. Overall, these early functional and related physiologic measurements will allow the estimation of nonlinear sensorimotor and cardiovascular recovery trends that have not been previously captured.

Reschke, M. F.↗

NASA Earth Systems Digital Twins (ESDT)

"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."

Earth Science Remote Sensing; Information Systems↗

Helmet-mounted pilot night vision systems: Human factors issues

Helmet-mounted displays of infrared imagery (forward-looking infrared (FLIR)) allow helicopter pilots to perform low level missions at night and in low visibility. However, pilots experience high visual and cognitive workload during these missions, and their performance capabilities may be reduced. Human factors problems inherent in existing systems stem from three primary sources: the nature of thermal imagery; the characteristics of specific FLIR systems; and the difficulty of using FLIR system for flying and/or visually acquiring and tracking objects in the environment. The pilot night vision system (PNVS) in the Apache AH-64 provides a monochrome, 30 by 40 deg helmet-mounted display of infrared imagery. Thermal imagery is inferior to television imagery in both resolution and contrast ratio. Gray shades represent temperatures differences rather than brightness variability, and images undergo significant changes over time. The limited field of view, displacement of the sensor from the pilot's eye position, and monocular presentation of a bright FLIR image (while the other eye remains dark-adapted) are all potential sources of disorientation, limitations in depth and distance estimation, sensations of apparent motion, and difficulties in target and obstacle detection. Insufficient information about human perceptual and performance limitations restrains the ability of human factors specialists to provide significantly improved specifications, training programs, or alternative designs. Additional research is required to determine the most critical problem areas and to propose solutions that consider the human as well as the development of technology.

Hart, Sandra G.↗