Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Flexible Automation in Air Traffic Control Through Adaptation of Human-Automation Collaboration
Linköpings universitet, Medie- och Informationsteknik.ORCID iD: 0000-0002-7917-5924
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The approach for the dissertation has been to use the known problems and issues with automation as a starting point, and then decompose that complex of problems and explore them to find possible solutions. Initiation of communication between automation and human, how and when it is performed, were identified as one critical point in the human-automation collaboration. This insight formed the basis for the two main concepts presented in this dissertation. The first concept is the Reduced Autonomy Workspace (RAW), a design approach that describes the process of when a highly autonomous automation needs to consult the human working together with the automation. Focus is on the temporal aspects, but it also includes transformation of the information content to reduce the cognitive effort on the human receiving the information. A visualization for future automation using glyphs based on the same principles was developed to support the RAW design approach. The glyphs were evaluated in workshops with operators from air traffic control, vessel traffic service, and train traffic management, respectively. The second main concept is a new type of attention support, Soft Visual Cues (SVC). The SVC complements other types of attention support which may, due to the automation’s lack of knowledge of the overall situation, draw the operator’s attention away from something potentially more important. Different designs were evaluated in operator workshops and tested by other air traffic controllers in a series of real-time simulations. In addition to these concepts, studies have also been performed to explore and gain a deeper knowledge of how the involved control processes can be understood, the effect of entangled control processes, and how domain specific prerequisites are reflected in the control processes.

Abstract [sv]

Utgångspunkten i avhandlingen är de redan kända utmaningarna med ökad automation och från det har problematiken brutits ner för att hitta förslag på lösningar. Ett avgörande moment i samarbetet mellan människa och automation är när automationen initierar kommunikation med människan. Den insikten har resulterat i två centrala koncept som presenteras i avhandlingen. Det första konceptet är designansatsen Reduced Autonomy Workspace (RAW) som beskriver hur anpassning av kommunikation mellan automation och människa kan utformas för situationer när automationen måste konsultera människan. De temporala aspekterna är mycket viktiga och designansatsen inkluderar också hur automationen ska transformera informationen till ett format som kräver så lite kognitiv ansträngning som möjligt för människan. En glyfbaserad visualisering för användning i framtida högautomatiserade system baserad på designansatsen RAW togs fram och utvärderades i ett an-tal workshops med operativa domänexperter från flygtrafikledning, sjötrafikinformationstjänst och tågtrafikledning. Det andra konceptet är en ny typ av visualiseringskoncept för uppmärksamhetsstöd, Soft Visual Cues (SVC), eller mjuka visuella påminnelser. Mjuka visuella påminnelser kompletterar andra typer av uppmärksamhetsstöd som aktivt drar uppmärksamheten till sig, vilket kan vara ett problem om användaren är upptagen med något viktigare som automationen på grund av en bristande helhetsbild inte känner till. Olika designalternativ utvärderades i workshopform tillsammans med flygledare och den föredragna designen testades sedan i realtidssimuleringar med andra flygledare. Utöver de framarbetade koncepten har också studier genomförts för att skapa en djupare förståelse för de ingående kontrollprocesserna, hur de påverkar varandra och hur domänspecifika förutsättningar avspeglas i dem.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2023. , p. 99
Series
Linköping studies in science and technology. Dissertations, ISSN 0345-7524 ; 2343
Keywords [en]
Human-Automation Collaboration, Flexible Automation, Interactive Information Visualization, Air Traffic Control
National Category
Human Computer Interaction
Identifiers
URN: urn:nbn:se:vti:diva-21342DOI: 10.3384/9789180753371ISBN: 9789180753180 (print)ISBN: 9789180753371 (electronic)OAI: oai:DiVA.org:vti-21342DiVA, id: diva2:1916502
Public defence
2023-12-12, K3, Kåkenhus, Campus Norrköping, 09:15 (English)
Opponent
Supervisors
Available from: 2024-11-27 Created: 2024-11-27 Last updated: 2025-09-11Bibliographically approved
List of papers
1. Attention Support with Soft Visual Cues in Control Room Environments
Open this publication in new window or tab >>Attention Support with Soft Visual Cues in Control Room Environments
2020 (English)In: 2020 24th International Conference Information Visualisation (IV), IEEE, 2020, p. 160-165Conference paper, Published paper (Refereed)
Abstract [en]

In visually demanding environments like working positions in air traffic control, there is a risk of missing important information. Attention support might help to reduce this, but there is a risk that it introduces new issues in the form of distractions or increased visual load. The work presented in this paper explores the concept of Soft Visual Cues, with the aim to make the operator aware of missing information, but doing it discreetly enough only to be noticed when the operator is scanning the area where the information is present, thereby complementing the concepts of attention guidance, alarms, and subtle gaze direction. The qualitative evaluation performed aimed primarily at catching the operators' (air traffic controllers) first impressions. Focus was on air traffic control, but was complemented with vessel traffic service and train control environments and operators. The results from air traffic control showed a preference for symbol property changes related to geometry rather than for colour or opacity changes as soft visual cues. The comparison to the other domains highlighted the contextual dependence, visual context and process context, of the concept.

Place, publisher, year, edition, pages
IEEE, 2020
Series
IEEE International Conference on Information Visualization, ISSN 1550-6037, E-ISSN 2375-0138
Keywords
Soft visual cues, attention support, adaptive automation, interactive visualization, air traffic control, train control, vessel traffic service
National Category
Production Engineering, Human Work Science and Ergonomics Human Computer Interaction
Identifiers
urn:nbn:se:vti:diva-21339 (URN)10.1109/iv51561.2020.00035 (DOI)2-s2.0-85102918941 (Scopus ID)9781728191355 (ISBN)9781728191348 (ISBN)
Conference
24th International Conference Information Visualisation (IV), Melbourne, Australia, September 7-11, 2020.
Available from: 2024-11-27 Created: 2024-11-27 Last updated: 2025-09-11Bibliographically approved
2. Reduced autonomy workspace (RAW): an interaction design approach for human-automation cooperation
Open this publication in new window or tab >>Reduced autonomy workspace (RAW): an interaction design approach for human-automation cooperation
2022 (English)In: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 24, no 2, p. 261-273Article in journal (Refereed) Published
Abstract [en]

Lack of support for handling a reduction of autonomy in a highly autonomous automation may lead to a stressful situation for a human when forced to take over. We present a design approach, the Reduced Autonomy Workspace, to address this. The starting point is that the human and the automation work together in parallel control processes, but at different levels of autonomy cognitive control, such as setting goals or implementing plans, which is different from levels of automation. When autonomy is reduced, the automation should consult the human by providing information that has been aligned to the level at which the human is working, and the timing of the provision should be adapted to suit the human’s work situation. This is made possible by allowing the automation to monitor the human in a separate process. The combination of these processes, information level alignment and timing of the presentation, are the key characteristics of the Reduced Autonomy Workspace. The Reduced Autonomy Workspace consists of four phases: Identification of the need; evaluation of whether, and, if so, when, and how to present information; perception and response by the human; implementation of a solution by the automation. The timing of the information presentation should be adapted in real-time to provide flexibility, while the level of the information provided should be tuned offline and kept constant to provide predictability. Use of the Reduced Autonomy Workspace can reduce the risk for surprising, stressful hand-over situations, and the need to monitor the automation to avoid them.

Place, publisher, year, edition, pages
Springer, 2022
Keywords
Reduced autonomy workspace, Levels of autonomy in cognitive control, Joint control framework, Air traffic management, Levels of automation, Automation ironies
National Category
Production Engineering, Human Work Science and Ergonomics Human Computer Interaction
Identifiers
urn:nbn:se:vti:diva-21341 (URN)10.1007/s10111-022-00695-2 (DOI)000746814300001 ()2-s2.0-85123488293 (Scopus ID)
Projects
F-AUTO
Funder
Swedish Transport Administration, TRV 2018/41347Linköpings universitet
Available from: 2024-11-27 Created: 2024-11-27 Last updated: 2025-09-11Bibliographically approved
3. Glyph design for communication initiation in real-time human-automation collaboration
Open this publication in new window or tab >>Glyph design for communication initiation in real-time human-automation collaboration
2024 (English)In: Visual Informatics, ISSN 2468-502X, no 4, p. 23-35Article in journal (Refereed) Published
Abstract [en]

Initiating communication and conveying critical information to the human operator is a key problem in human-automation collaboration. This problem is particularly pronounced in time-constrained safety critical domains such as in Air Traffic Management. A visual representation should aid operators understanding why the system initiates the communication, when the operator must act, and the consequences of not responding to the cue. Data glyphs can be used to present multidimensional data, including temporal data in a compact format to facilitate this type of communication. In this paper, we propose a glyph design for communication initialization for highly automated systems in Air Traffic Management, Vessel Traffic Service, and Train Traffic Management. The design was assessed by experts in these domains in three workshop sessions. The results showed that the number of glyphs to be presented simultaneously and the type of situation were domain-specific glyph design aspects that need to be adjusted for each work domain. The results also showed that the core of the glyph design could be reused between domains, and that the operators could successfully interpret the temporal data representations. We discuss similarities and differences in the applicability of the glyph design between the different domains, and finally, we provide some suggestions for future work based on the results from this study.

Place, publisher, year, edition, pages
Elsevier, 2024
Keywords
Glyphs, Real-time, Multidimensional data, Information visualization, Human-automation collaboration, Control rooms
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:vti:diva-21333 (URN)10.1016/j.visinf.2024.09.006 (DOI)001386318900001 ()2-s2.0-85211992279 (Scopus ID)
Projects
F-AUTO
Funder
Swedish Transport Administration, TRV 2018/41347Swedish Transport Administration, TRV 2020/138317
Available from: 2024-11-27 Created: 2024-11-27 Last updated: 2026-03-17Bibliographically approved
4. Modelling operator control work across traffic management domains: implications for interaction design
Open this publication in new window or tab >>Modelling operator control work across traffic management domains: implications for interaction design
Show others...
2024 (English)In: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 26, no 2, p. 281-299Article in journal (Refereed) Published
Abstract [en]

Traffic management in aviation, shipping, and rail transport shows similarities and dissimilarities in the work process. For example, they share the temporal aspect, but different levels of urgency in the control work set different requirements on monitoring, decisions, and actions. However, few studies have been presented that model and compare the different domains in terms of temporal decision-making. The Joint Control Framework (JCF) is an approach to analyse and temporally model operators’ control processes from a cognitive systems engineering perspective. In this study, we have used JCF to map, and compare, cognitive joints, such as perceptions, decisions, and actions, in temporally challenging control situations in air traffic control, maritime vessel traffic service, and train traffic management. Data was collected collaboratively with traffic operators, focusing on (1) identifying challenging traffic situations and (2) jointly modelling the temporal decision-making patterns of these situations using simplified JCF. Post-analysis was done by breaking down the results into different processes and comparing domains to ascertain how operators maintain control. An intermediate level of activity—between general monitoring and work with specific vehicles—was identified: processes-in-focus. A shared problem arises in the shift between general monitoring and the processes-in-focus. All processes-in-focus comprise cognitive joint cycles of perceptions, decisions, and actions. However, depending on the framing of processes-in-focus, the patterns of joints, such as temporal extension and complexity, differ. In the remainder of the article, implications for the interaction design, in particular the potential for human–AI/automation teaming with higher levels of automation and cognitive autonomy, are discussed. 

Place, publisher, year, edition, pages
Springer, 2024
Keywords
Interaction design, Temporal modelling, Traffic management, Cognitive systems engineering, Human–AI/automation teaming
National Category
Transport Systems and Logistics Computer Systems
Identifiers
urn:nbn:se:vti:diva-20464 (URN)10.1007/s10111-024-00754-w (DOI)001183431000001 ()2-s2.0-85187651775 (Scopus ID)
Projects
F-AUTO
Funder
Swedish Transport Administration, TRV 2018/41347Swedish Transport Administration, TRV 2020/138317
Available from: 2024-03-20 Created: 2024-03-20 Last updated: 2025-09-11Bibliographically approved

Open Access in DiVA

fulltext(5328 kB)140 downloads
File information
File name FULLTEXT01.pdfFile size 5328 kBChecksum SHA-512
98d4de374535e9849d9468433debf8093aa27f647eff519587b8a90b83d88d6a4a2427aae08ac3767a994239622e0f4c72469c7e348f9e62e605932e8e01405b
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Nylin, Magnus

Search in DiVA

By author/editor
Nylin, Magnus
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar
Total: 140 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 312 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf