WORLD DESK // 03

research index ↙

IEEE TVCG · MANUSCRIPT IN PREPARATION

Multilingual Visualization Interpretation

When a chart crosses a language boundary, what exactly has to travel with it?

I study how people interpret, explain, and recreate visualizations across linguistic and cultural contexts. Rather than treating localization as text translation alone, this work examines how people reason about notation, layout, visual convention, and what should change when a chart is adapted for another audience.

Printed Arabic, Chinese, and European charts arranged as multilingual visualization research materials on a desk
Charts across locales // language, notation, layout, visual convention.

because apparently charts also have accents

research brief // 03

At a Glance

Question
What changes when people interpret and adapt charts from unfamiliar locales?
Study
A multi-stage participant study moving from interpretation → explanation → recreation.
Tasks
Read unfamiliar charts · explain them for another audience · recreate/localize them.
Measurement
Output quality · locale awareness · tool-use strategy · data fidelity · completeness.
My role
Study design · task design · coding framework · human evaluation · analysis.
Status
Extended from IEEE VIS short-paper work into a fuller manuscript for IEEE TVCG.

from encounter to redesign

How the Study Works

The study follows what happens as a person moves from simply encountering an unfamiliar chart to communicating and ultimately redesigning it for someone else.

  1. 01

    Interpret

    What does this chart say?

    Participants first make sense of an unfamiliar visualization and its data, labels, notation, and conventions.

  2. 02

    Explain

    How would you communicate it?

    They explain the chart for another audience, revealing what information they preserve, omit, translate, or reinterpret.

  3. 03

    Recreate

    What would you change?

    They adapt the chart for a new audience, making explicit decisions about language, notation, layout, and visual semantics.

language · numeric notation · dates + units · layout + direction · color semantics · tool use

layers of localization

What Has to Travel?

01

Language

Labels, scripts, titles, legends.

02

Notation

Numbers, dates, currencies, units.

03

Visual convention

Reading direction, axis placement, color meanings.

04

Tool use

Search, translation systems, generative AI, and other ad-hoc assistance.

Localization becomes interesting precisely because these layers do not always travel together.

contribution ledger

What I Built

01

Multi-stage study protocol

Designed a participant-study structure that separates interpretation, explanation, and recreation rather than treating visualization understanding as a single task.

02

Task design

Developed chart tasks that expose different kinds of locale-dependent reasoning while still allowing participants to work naturally with external tools.

03

Human coding framework

Built a structured coding scheme for participant responses, awareness of locale-specific conventions, and tool-use behavior.

04

Component-level evaluation

Designed evaluation criteria for participant-created visualizations so that language, notation, visual convention, fidelity, and completeness can be assessed separately rather than collapsed into one accuracy score.

05

Analysis framework

Structured the study so that participant behavior, produced artifacts, tool use, and workload can be analyzed together.

the interaction question

Why This Is an HCI Problem

Visualization localization is usually framed as a translation problem.

But people interact with charts through learned conventions: how numbers are grouped, where axes appear, what colors imply, which direction information is read, and which tools they trust when something feels unfamiliar.

This project studies that interaction between people, visual conventions, and the tools used to bridge unfamiliarity.

The broader design question is not simply “can we translate this chart?” but: what should a visualization system preserve, explain, adapt, or redesign when meaning depends on locale?

working premise

Localization is not only translation. It is a design decision about what meaning needs to travel.

open questions

Questions I’m Following

  • What gets preserved?
  • What gets translated?
  • What needs explanation?
  • What has to be redesigned?
  • What do people notice on their own — and what do their tools notice for them?

apparently the bars are universal. everything around them has opinions.

methods

Methods

participant study · task design · visualization evaluation · structured coding · human evaluation · tool-use analysis · workload measurement · cross-cultural HCI

where this is going

From IEEE VIS to IEEE TVCG

This work began as an IEEE VIS short-paper submission. Reviewer feedback encouraged us to develop the study more substantially, so we are extending it into a fuller manuscript for IEEE Transactions on Visualization and Computer Graphics (TVCG).

The extended version deepens the participant study, coding framework, and analysis across interpretation, explanation, and recreation.

the short paper acquired ambitions.

full research index ↓