For many couples, excessive smartphone use can be a source of conflict. But for David Duda and Hong Liang, a married couple in New Haven, Connecticut, their phones are an indispensable lifeline. They even carry eight external battery packs, understanding that if their devices die, so does their primary mode of communication.
David, 62, speaks English, while Hong, 57, speaks Mandarin. Their daily interactions hinge on Microsoft’s free Translator app, which provides real-time text translations of their spoken words, much like subtitles for everyday life.
Despite three years of marriage, they walk arm-in-arm, not just for affection, but out of necessity. One might chat and navigate, while the other’s gaze is fixed on the screen, meticulously reading translated remarks. When David cracks a joke, he patiently waits a few seconds for Hong to read the translation before both share a laugh.
Deepening Connection Through Technology
This unique method of communication demands unwavering attention. There’s no such thing as a half-heard remark or a shouted conversation from another room. To truly connect, they dedicate hours on the couch or in bed, ensuring mutual understanding of every word exchanged.
“The translator forces you to be more present because you have to be actively reading and listening,” David explains. “It demands more attention, which is a wonderful thing in a marital relationship.”
Hong, through a human interpreter, shares her perspective: “He pays attention to all the details and takes good care of me. He truly understands and anticipates my needs.” (A direct machine translation of her sentiment conveyed: “He is very attentive. He thought about anything for me, so I was impressed by a lot of his details.”)
The rise of automated translation has opened new doors for people like David and Hong, allowing attraction to flourish beyond linguistic fluency. It’s also transforming global travel and enabling businesses to reach new audiences.
Even during an interview, using real-time translation tools like Apple AirPods and Microsoft Translator presented challenges due to delays and misunderstandings, which were only fully clarified by a professional interpreter later. Yet, cognitive science professor Lera Boroditsky of UC San Diego notes, “It’s wonderful that people are able to communicate with a much wider range of people than they could before. Those translations are going to be imperfect, but having access is better than not having access.”
The concept of a universal translator, once confined to science fiction like Star Trek, is steadily becoming a reality. Tools from Microsoft and other tech giants can now assist with over 100 of the world’s 7,000 languages. While perfect fluency might still be a distant dream, these technologies enable billions to at least muddle through, fostering connections previously unimaginable.
French author André Maurois famously wrote, “A happy marriage is a long conversation that always seems too short.” For David and Hong, their enduring conversation began at a time when such technological aids were available, and their patience allowed them to harness these tools.
“It’s actually quite fun for us,” David chuckles. “If people weren’t in love, it would be far more frustrating.”
Love in Translation
David and Hong’s story began in Xian, China, in the autumn of 2019. David had accompanied his brother on a business trip, eager to explore the Terracotta soldiers and Buddhist temples. His brother’s business partner arranged for Hong to drive David around, and by week’s end, David was completely captivated by her joy and happiness. He felt a strong connection and, in a moment of boldness, attempted to kiss her goodbye before his departure. Hong, surprised, offered her cheek instead.
Their interest, however, was mutual. After David returned to his bookstore in New Haven, they continued to communicate through WeChat, a Chinese messaging app. Hong would copy and paste David’s English messages into a translator, bridging the gap word by word.
Just months later, the world was plunged into the COVID-19 pandemic. Both divorced with adult children, David and Hong found solace in daily messages, delving into their pasts, their previous marriages, and their families. With stores closed, David’s work shifted to online book shipments, aligning his nocturnal schedule with Hong’s time zone, allowing them to connect more frequently.
“We spent the next two years on our phones getting to know each other better,” David recounts.
In September 2022, as China eased travel restrictions, Hong took a leap of faith and booked a one-way flight to the United States. A wave of nervousness washed over her: Would David be the person she had come to know through translated texts?
At the airport, David met her with a sign bearing Chinese characters that read, “Love of my life.”
“I was deeply touched, because at the airport in front of so many people, he did something that touched my heart,” Hong remembers. (A direct machine translation conveyed: “I think this is a very, very romantic thing, and in front of so many people at the airport.” This highlights potential nuances lost in direct machine translation.)
Understanding the Nuances: The Challenge of AI Translation
Automated language translation has been a pursuit of computer scientists since the 1950s. Early Georgetown University researchers developed a system to translate a few hundred Russian words into English. However, true translation involves far more than direct word swapping; it grapples with grammar, structure, contextual meanings, and the notorious challenge of idioms. These complexities posed significant hurdles for machine learning.
The early 2000s saw Google and Microsoft offer web-based statistical translation services. The real breakthrough came a decade later when Google researchers introduced a new technique for processing massive datasets, paving the way for advanced AI like chatbots. This fundamental shift in language processing proved highly effective for English-to-French and English-to-German translations.
Since then, automated text translation has achieved impressive accuracy. However, spoken language translation still lags, encountering greater difficulties.
While communicating via WeChat, David and Hong sometimes forgot their language differences. In-person, the communication proved more demanding. They initially tried a $600 handheld translator and earbuds that offered spoken translations, but these required Wi-Fi and failed amidst background noise. Eventually, they found their solution in the Microsoft Translator app, which provides text translations of their speech. While generative AI chatbots like ChatGPT and Claude are increasingly used for translation, David and Hong haven’t yet explored those options.
Their entire married conversation now resides within a corporate database, a fact David isn’t troubled by. He has even granted Microsoft permission to use his audio clips to further refine their technology.
The Imperfections and The Patience
The Translator app isn’t flawless. Wallace Chen, a professor of Chinese-English translation and interpretation at Middlebury College, reviewed an interview with the couple, noting that while simple exchanges were handled adequately, longer conversations often faltered.
For instance, when Hong described her initial arrival in the U.S. and contracting COVID-19, leading her to believe she was dying, the app translated “novel corona” (the Chinese term for COVID-19) as “new crown.” This led to a humorous, albeit confusing, exchange where the interviewer mistakenly thought Hong meant David’s romantic gesture was so touching it made her “want to die.” David’s unwavering support during her illness was what she was trying to convey, deepening her affection for him.
Other communication breakdowns occurred when Hong’s longer responses overwhelmed the speech-to-text transcription, resulting in missed words or entire sentences— akin to a patchy phone call. Chris Wendt, a former Microsoft Translator program manager, noted that speakers must verify the app’s transcription in real-time. This means looking at the phone, not the person you’re speaking with, a detail that surprised David and Hong. “Why didn’t they tell us that two years ago?” David quipped.
Philipp Koehn, a machine translation pioneer at Johns Hopkins, explains that converting speech to text is inherently challenging, even without translation. Factors like microphone quality, ambient noise, and overlapping speech can all hinder accuracy. Spoken language is also rich with accents, dialects, subtle hesitations, and emotional tones that are often lost in translation. People speak rapidly, ramble, or leave thoughts half-formed.
Dr. Chen advises caution when using automated translators “in situations where every word matters.”
David and Hong are keenly aware of the app’s inaccuracies. They have their own playful phrase for these moments: “bù bù hǎo,” a phonetic twist on a Chinese idiom meaning “not good.” When translation fails, they resort to rephrasing, body language, or even searching for illustrative photos online. Sometimes, words, translated or not, simply fall short.
Big Ambitions, Real Connections
Microsoft declined to comment directly on the app’s use in a marriage, but former program manager Chris Wendt confirmed that supporting such connections was indeed the original intent. “We thought it was possible,” he said.
Wendt and his team envisioned a world connected by breaking down language barriers. In 2014, Microsoft showcased simultaneous translation during a Skype call between schoolgirls in Seattle and Mexico City, demonstrating a future where computer-generated voices could seamlessly bridge linguistic divides.
Today, the translation industry is valued at $31 billion. Social media platforms like YouTube and Instagram offer automatic video translation and dubbing. Amazon is exploring AI-aided dubbing for foreign films and even AI translation for self-published Kindle books. Reddit has translated its entire site into 30 languages, and many video call services now include real-time translation features.
Wendt likens AI translation to GPS navigation: “When you have GPS, you’re not afraid of getting lost. It enables you to go into situations you would not normally go into.”
Just two months after Hong’s arrival, David knew he wanted her to stay forever. During Thanksgiving dinner with his family, he got down on one knee and attempted to propose in Chinese. Hong didn’t understand the words, but the gesture was unmistakable. They married a month later.
Their married life, filled with dining out, biking, beach walks, and watching shows with Chinese subtitles (they enjoyed “Ted Lasso”), mirrors many other couples. Yet, in one significant aspect, they are unique: three years in, they haven’t had a single fight. A heated argument, often fueled by quick-fire exchanges, is nearly impossible with the Translator app as an intermediary.
“Maybe the best way to have a lasting marriage is to speak different languages,” David jokes.
Their age and previous divorces have also contributed to their communication success, they believe. Having experienced past marital challenges, they now have a deeper understanding of what makes a relationship thrive. They are also highly attuned to non-verbal cues. Hong notes that David’s facial expressions and gestures convey his emotions more effectively than any app.
Per Urlaub, a professor and director of global languages at M.I.T., acknowledges the apps’ limitations with “metaphors, sense of humor, tone register, cultural references.” However, for David and Hong, he concludes, the apps “are meaningful and functional.”
“Technology is making intimacy possible under conditions where it otherwise would not exist,” he states. “In this case, I feel that the proof is in the pudding.”
A Modern “Love Actually”
Fans of “Love Actually” might expect David and Hong to have diligently learned each other’s languages. While both are making efforts – David with Duolingo and children’s books for Mandarin, and Hong with English classes and apps – they estimate knowing only about 200 words in each other’s language. David feels he’s too old to achieve fluency.
They attribute the success of their relationship to their deep infatuation. David admits that if their initial passion were to fade, the constant effort of using translation apps might become overwhelming. Hong, intently reading a translation on her phone, then looked up and shared a poignant Chinese saying: “Two people are together because they don’t know each other. We want to explore each other’s secrets.”
She watched him, waiting for him to finish reading her translated words before she burst into laughter, hinting that once all secrets are revealed, the interest might wane. A moment of shared humor, transcending language, powered by technology.