PRIYANSHU KUMARPRIYANSHU KUMAR
(Case 04 / 07)IIT Bhubaneswar

Students translating the lecture in their heads 

Built forIIT Bhubaneswar
WatchingOne live microphone in the hall
Built byMe, alone
ReadJump to what went wrong ↓Jump to what went wrong ↓

(01) The problem

A teacher speaks in English, with Hindi mixed into the same sentence. That is how people really talk. Some students in the room think in Tamil, or Odia, or Bengali. They turn each sentence into their own words, and the class has moved on.

(02) What I built

One microphone feeds software I wrote and run. It turns what he says into English text, even when Hindi and English share one sentence. Then each finished line goes out in the language a student picked. The teacher is still on that point. Twenty-two languages are set up. Ten run at once.

Each caption arrives withThe sentence just spokenThe language they pickedIn step with the speaker
One minute of the hall drawn as loudness: the teacher as tall peaks, the room as a low flat band, and the bar for speech held down under his peaks by the cap.
What it reads
A phone screen showing the same finished sentence arriving in Tamil, Odia and Bengali, with a language picker.
What a person receives

Both pictures are drawings of the real thing, not photographs of it. The shape is what runs; the sentence being taught in them is made up.

(03) What went wrong

Four minutes in, the captions stopped. He kept talking.

How I found out

Nothing crashed. So I read the loudness numbers it prints anyway. The room's hum had pushed the bar for speech above the teacher. It had decided he was background noise.

What I changed

The bar is now capped at half of his loudest recent moment. Noise can raise it, never above the person talking. A test called no choke fails if unbroken speech stops reaching the screen.

(04) What happened

A whole hour now reaches the phones, in up to ten languages at once. Quiet is never a mystery.

All cases01 Rules nobody had time to read01 Rules nobody had time to read02 Customers asking in the wrong places02 Customers asking in the wrong places03 Two lists that did not agree03 Two lists that did not agree04 Students translating the lecture in their heads04 Students translating the lecture in their heads05 Messages that only make sense together05 Messages that only make sense together06 Ad money going out with nothing coming back06 Ad money going out with nothing coming back07 A progress bar that proves nothing07 A progress bar that proves nothing
(Next case 05)A developer test. The code is public.Messages that only make sense together →Messages that only make sense together →