Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Glyph design for communication initiation in real-time human-automation collaboration
Department of Science and Technology, Linköping University, Norrköping, Sweden; Department of Research and Innovation and Digitalization, Air Navigation Services of Sweden (LFV), Norrköping, Sweden.ORCID iD: 0000-0002-7917-5924
Department of Science and Technology, Linköping University, Norrköping, Sweden.ORCID iD: 0000-0001-8862-7331
Department of Computer and Information Science, Linköping University, Linköping, Sweden.
Department of Science and Technology, Linköping University, Norrköping, Sweden.ORCID iD: 0000-0002-1907-7820
2024 (English)In: Visual Informatics, ISSN 2468-502X, no 4, p. 23-35Article in journal (Refereed) Published
Abstract [en]

Initiating communication and conveying critical information to the human operator is a key problem in human-automation collaboration. This problem is particularly pronounced in time-constrained safety critical domains such as in Air Traffic Management. A visual representation should aid operators understanding why the system initiates the communication, when the operator must act, and the consequences of not responding to the cue. Data glyphs can be used to present multidimensional data, including temporal data in a compact format to facilitate this type of communication. In this paper, we propose a glyph design for communication initialization for highly automated systems in Air Traffic Management, Vessel Traffic Service, and Train Traffic Management. The design was assessed by experts in these domains in three workshop sessions. The results showed that the number of glyphs to be presented simultaneously and the type of situation were domain-specific glyph design aspects that need to be adjusted for each work domain. The results also showed that the core of the glyph design could be reused between domains, and that the operators could successfully interpret the temporal data representations. We discuss similarities and differences in the applicability of the glyph design between the different domains, and finally, we provide some suggestions for future work based on the results from this study.

Place, publisher, year, edition, pages
Elsevier, 2024. no 4, p. 23-35
Keywords [en]
Glyphs, Real-time, Multidimensional data, Information visualization, Human-automation collaboration, Control rooms
National Category
Human Computer Interaction
Identifiers
URN: urn:nbn:se:vti:diva-21333DOI: 10.1016/j.visinf.2024.09.006ISI: 001386318900001Scopus ID: 2-s2.0-85211992279OAI: oai:DiVA.org:vti-21333DiVA, id: diva2:1916506
Projects
F-AUTO
Funder
Swedish Transport Administration, TRV 2018/41347Swedish Transport Administration, TRV 2020/138317Available from: 2024-11-27 Created: 2024-11-27 Last updated: 2026-03-17Bibliographically approved
In thesis
1. Flexible Automation in Air Traffic Control Through Adaptation of Human-Automation Collaboration
Open this publication in new window or tab >>Flexible Automation in Air Traffic Control Through Adaptation of Human-Automation Collaboration
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The approach for the dissertation has been to use the known problems and issues with automation as a starting point, and then decompose that complex of problems and explore them to find possible solutions. Initiation of communication between automation and human, how and when it is performed, were identified as one critical point in the human-automation collaboration. This insight formed the basis for the two main concepts presented in this dissertation. The first concept is the Reduced Autonomy Workspace (RAW), a design approach that describes the process of when a highly autonomous automation needs to consult the human working together with the automation. Focus is on the temporal aspects, but it also includes transformation of the information content to reduce the cognitive effort on the human receiving the information. A visualization for future automation using glyphs based on the same principles was developed to support the RAW design approach. The glyphs were evaluated in workshops with operators from air traffic control, vessel traffic service, and train traffic management, respectively. The second main concept is a new type of attention support, Soft Visual Cues (SVC). The SVC complements other types of attention support which may, due to the automation’s lack of knowledge of the overall situation, draw the operator’s attention away from something potentially more important. Different designs were evaluated in operator workshops and tested by other air traffic controllers in a series of real-time simulations. In addition to these concepts, studies have also been performed to explore and gain a deeper knowledge of how the involved control processes can be understood, the effect of entangled control processes, and how domain specific prerequisites are reflected in the control processes.

Abstract [sv]

Utgångspunkten i avhandlingen är de redan kända utmaningarna med ökad automation och från det har problematiken brutits ner för att hitta förslag på lösningar. Ett avgörande moment i samarbetet mellan människa och automation är när automationen initierar kommunikation med människan. Den insikten har resulterat i två centrala koncept som presenteras i avhandlingen. Det första konceptet är designansatsen Reduced Autonomy Workspace (RAW) som beskriver hur anpassning av kommunikation mellan automation och människa kan utformas för situationer när automationen måste konsultera människan. De temporala aspekterna är mycket viktiga och designansatsen inkluderar också hur automationen ska transformera informationen till ett format som kräver så lite kognitiv ansträngning som möjligt för människan. En glyfbaserad visualisering för användning i framtida högautomatiserade system baserad på designansatsen RAW togs fram och utvärderades i ett an-tal workshops med operativa domänexperter från flygtrafikledning, sjötrafikinformationstjänst och tågtrafikledning. Det andra konceptet är en ny typ av visualiseringskoncept för uppmärksamhetsstöd, Soft Visual Cues (SVC), eller mjuka visuella påminnelser. Mjuka visuella påminnelser kompletterar andra typer av uppmärksamhetsstöd som aktivt drar uppmärksamheten till sig, vilket kan vara ett problem om användaren är upptagen med något viktigare som automationen på grund av en bristande helhetsbild inte känner till. Olika designalternativ utvärderades i workshopform tillsammans med flygledare och den föredragna designen testades sedan i realtidssimuleringar med andra flygledare. Utöver de framarbetade koncepten har också studier genomförts för att skapa en djupare förståelse för de ingående kontrollprocesserna, hur de påverkar varandra och hur domänspecifika förutsättningar avspeglas i dem.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2023. p. 99
Series
Linköping studies in science and technology. Dissertations, ISSN 0345-7524 ; 2343
Keywords
Human-Automation Collaboration, Flexible Automation, Interactive Information Visualization, Air Traffic Control
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:vti:diva-21342 (URN)10.3384/9789180753371 (DOI)9789180753180 (ISBN)9789180753371 (ISBN)
Public defence
2023-12-12, K3, Kåkenhus, Campus Norrköping, 09:15 (English)
Opponent
Supervisors
Available from: 2024-11-27 Created: 2024-11-27 Last updated: 2025-09-11Bibliographically approved

Open Access in DiVA

fulltext(1271 kB)9 downloads
File information
File name FULLTEXT02.pdfFile size 1271 kBChecksum SHA-512
150075b30f887dd750113984ca0a59b90521460721b2dc424e409c8390eebcd19384cdded6cb97f3936117166f71b44b581968e5fd6596d41b7565773a623872
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Nylin, Magnus

Search in DiVA

By author/editor
Nylin, MagnusLundberg, JonasKucher, Kostiantyn
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar
Total: 137 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 321 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf