Morning Glory & Afternoon Memories — Chapter 16: Mourning the Semantic Master, Mr. Dong Zhendong

In 2019, when the devastating news reached me, I was on the road. Stunned beyond words, my head was buzzing. I had just stepped off the high-speed train when my father was the first to relay the message, earlier than any of my WeChat groups. He must have been following the news from the Chinese Information Processing Society of China, the nation's highest academic body for NLP. He had often heard me speak of Professor Dong.

My old friend Nick urged me not to forget to write a memorial piece. Having followed and benefited from the Master for over thirty years, my heart brims with memories — thousands of threads, tangled and endless. Where do I even begin?

Not long after the turmoil of 1989, the Second Summit Conference on Machine Translation was held in Munich, Germany. I attended on behalf of Professor Liu Zhuo, presenting our JFY translation system. Professor Dong was also present. After the conference, we were invited to the multilingual machine translation group at BSO in the Netherlands for their "Chinese Week," to discuss incorporating Chinese into their multilingual framework and to explore the challenges of Chinese language processing.

Many years later, Professor Dong wrote to tell me that his children had been sorting through old photographs and unearthed a group picture from the Netherlands — a precious find. The man in the photo, Witkam, was the BSO project lead. It was he who had secured funding for the machine translation project from the European Community, with BSO covering the other half, which made possible their five-year plan for a multilingual MT system using Esperanto as the interlingua. The Chinese component was the dependency grammar I built for them — entirely a paper exercise, but it did sketch out the rudiments of formalized Chinese. Professor Dong was full of praise and encouragement for this work.


[Photo: Witkam, BSO Multilingual MT Project Lead; Professor Dong; and Li Wei (1989)]

I later sent him back a parting group photo taken during our time together on the machine translation project at Gaoli Company. That stint at Gaoli was a stroke of serendipity — I was able to spend several months working alongside Professor Dong in an office converted from a basement, listening to his teaching firsthand.


[Photo: Bottom row, left to right: Gaoli CEO; Professor Liu Zhuo; Li Wei; Professor Dong Zhendong (1991)]

In April 2013, Professor Dong wrote back:

Thank you. These photographs are extremely precious to all of us. I was already 54 that year, but my physical and mental vigor were still quite good. Another twenty years have passed. I'm still thinking of challenging myself once more. At the very least, I will keep pushing our HowNet-based MT system forward, to see just how far it can go. When I went back to receive an award, I visited Professor Liu. He mentioned that the institute had suggested he continue to supervise students. He felt he had no research topics and that funding was hard to come by, so he didn't accept. After returning, I thought it over and felt he should perhaps still do something. Who knows — he might break new ground.

I recently received a letter from the society about the 2013 Computational Linguistics Conference. After reading their call for papers, I felt I had something to say. Once I write it, I'll forward it to you for reference.

Has the household been lively? Girls grow up fast — not so easy to manage anymore.

Zhendong

My reply:

April 27, 2013

That must have been during the gestation of HowNet. I remember you mentioned a few ideas at the time.

Last time you mentioned using fine-grained classification to resolve structural ambiguity (the PP-attachment type of problem). It might be feasible with careful work, but I believe the fundamental solution to structural ambiguity lies not in artificial taxonomies but in statistics. Structural ambiguity is, at bottom, a love triangle — which element pairs with which ultimately depends on the relative strength of semantic attractions. And this relative attraction between AC and BC cannot be computed in advance, because there are far too many combinatorial possibilities. However, the attraction weight of AC or BC individually can be learned from large-scale data (essentially, lexical coherence acquisition). If we have a mechanism to bring this statistical information to bear at the moment of structural ambiguity and compare the scores, the problem can in theory be solved. This should be more effective and reasonable than manually tuning with fine-grained semantic features.

In fact, such a mechanism is already implementable. Admittedly, the implementation is still somewhat cumbersome, and the cost needs further investigation.

This visit, I felt that Professor Liu had aged considerably, more frail and slower. I suspect he no longer has the energy required. I understand your meaning — having spent a lifetime in research, even in retirement, it's best not to come to a complete stop, unless one has other passions. Sadly, many of us, aside from building systems, have no other hobbies. Retirement can be lonely.

Your student, Wei

Over more than thirty years of interaction with Professor Dong, beyond exchanging pleasantries about life, what we discussed most was our shared field. Professor Dong was a man of genuine feeling, rich in humor, and he could often make people laugh. I remember once, talking about his "Yi Xing" (TranStar) system, he said: That is my true child — a crystallization of painstaking effort. Then, laughing, he added: "My son and daughter don't count. Why? They're the result of 'natural disasters.'" Yet many years later, he spoke to me again about his children, hoping I might have the chance to bring his son Dong Qiang along to build something together, enumerating the child's strengths and weaknesses. In the end, he couldn't resist adding: "One's own child — even a scabby head is beautiful."

In the history of machine translation in China, my advisor was a true pioneer: Professor Liu Yongquan began assembling a team in 1957-1958, recruiting Professor Liu Zhuo from the Foreign Languages Institute and the late Professor Gao Zushun. Their first successful experiment came in 1959, and the three later co-authored A Brief Introduction to Machine Translation (which Japan later used as a primary reference during its MT research, translating it into Japanese). Professor Dong likely joined the Two Lius' MT project sometime in the 1960s, as a faculty member of the Foreign Languages Department at Heilongjiang University. He held both Professor Lius — who were as much elder brothers as teachers — in the deepest respect. A few years ago, he told me he had visited each of them individually to pay his respects.

Professor Dong surpassed his mentors, later taking the lead at the Academy of Military Sciences in turning MT into deployable, open software, becoming one of the foremost figures in Chinese MT and NLP. Looking at international exchange, for a long period Professor Dong served as China's NLP ambassador, the interface with the global academic community. From the Academy's "Keyan No. 1" — a practical, open English-Chinese machine translation prototype — to its commercial landing at China Software, where the first commercial product "Yi Xing" (TranStar) was launched, he set an example for nearly ten nationwide MT teams: MT could walk out of the laboratory.

Yi Xing was a milestone.

Professor Dong later shared his lessons learned from that experience. The most important one: don't spin your wheels in place. Focus on the big picture and let go of small details. Once R&D reaches a certain stage, rapidly expand the test set, open the system to others for testing, and grow through error. Before Yi Xing, R&D was essentially done on very small development sets — in those days, there was no distinction between development and test sets, and systems were typically not opened to outsiders. Academic evaluation meetings mostly involved drawing a few samples from a closed set. The computing conditions were also poor back then: you'd type in a sentence, and the evaluation committee members would go out for coffee and come back before the results appeared. Professor Dong's "Keyan No. 1" evaluation meeting was the first event to open the system to external expert evaluators for real testing. This took both nerve and courage in those years. I vividly recall accompanying Professor Liu to the Academy to participate in the "Keyan No. 1" system evaluation. Outside the hall, past translation samples and system documentation were on display. Inside the hall, experts challenged the system with various sentences. The open testing made a deep impression on me.

Professor Dong had an excellent relationship with Professor Su Keyi of Taiwan. He told me: "Look at Professor Su — he started a translation company purely out of passion for MT. The software may not be very refined, but he dares to use it boldly and iterate continuously."

At the end of the 1980s, Gaoli Company approached Professor Liu for collaboration, deciding to build a next-generation MT product based on Liu's JFY-IV expert dictionary system. By then, we had already learned from Professor Dong's open practice to pick up our pace. Previously, we could spend one or two years repeatedly polishing just a few hundred sentences.

Professor Dong himself acknowledged that, from a design perspective, Professor Liu's expert dictionary system was superior to Yi Xing and held greater potential. He had been invited to participate in the Gaoli project too, but by then his focus had already shifted — he was beginning to gestate Zhi Wang (HowNet). I clearly recall, during a lunchtime chat, Professor Dong saying that he felt the foundational knowledge resources for machine translation were insufficient, and that we needed to strengthen semantic ontology knowledge from the roots, including common sense. That endeavor lasted thirty years!

Let me explain the international academic background of this project. Professor Dong's approach to MT was built on the deep case grammar framework of the renowned semanticist Fillmore, which he suitably adapted and named "Logical Semantics." He used this framework as the internal structure (interlingua) for translation and transfer, publishing several influential papers demonstrating that this representation was sufficiently deep and well-suited for translation between languages of different families. I, too, was fascinated by deep case theory at the time and deeply convinced by Professor Dong's work — an influence that has persisted to this day, which is why I have always insisted that deep parsing is the principal source of NLP's "nuclear weapons." However, once Logical Semantics had a suitable graph-structure representation, it only resolved the semantic relationships at the structural level. The ontological knowledge of the lexical concepts at the nodes — their intrinsic semantics — had not yet caught up to complete the knowledge system. The most important ontological knowledge includes the subcategorization patterns of predicates with their potential sentence structures, the required argument types, and their roles. For example, the predicate EAT requires two arguments in its subcategorization frame: one demands a human or animal (Logical Subject), the other demands food (Logical Object). This is essentially common sense, requiring an ontological knowledge base to formalize common sense.

And so HowNet was born — finely classifying cross-lingual concepts, encoding human common sense through sememes and their relations, and establishing a formalized ontological knowledge system with logical-semantic representation. It is a work of genius that no ordinary human effort could achieve, a dispensation of divine light upon Professor Dong, and China's gift to human civilization. People in our field speak of how the three pioneers of deep neural networks sat on the cold bench for twenty to thirty years before finally being honored with the Turing Award. Professor Dong sat on the cold bench for over thirty years, and largely remains a hidden treasure unknown to the world. HowNet may well be a Turing-level contribution to human cognition. I believe that someday, when MT and NLU applications have exhausted all the low-hanging fruit of shallow approaches, knowledge systems will be further excavated, utilized, and appreciated.

In those days, WordNet already existed, but that system was led by psychologists and had many things that didn't sit right. Building a conceptual lexicon is grueling labor — few are willing to do it, even fewer are capable, and among those both willing and capable, very few can sustain the effort to complete such an enormous project. Although WordNet was never designed for NLP or MT, for lack of alternatives, when practitioners reached a certain depth and needed to draw on semantic resources, they would still use it, or adapt it. Professor Dong, with his erudition and depth, refused to settle. He had his own system design and his own conviction. He would tear it all down and build anew — a body of ontological knowledge better suited to machine translation and NLP.

Such work only saints and true masters can undertake. The scholarly threshold for ontological knowledge systems is extraordinarily high, encompassing the full spectrum of fundamental concepts, relations, and common sense. Even assuming one has devised a logically coherent and reasonably sound architecture, the work inside it is immensely arduous.

HowNet is Professor Dong's immortal monument.

After I went abroad in 1991, I became a wanderer, drifting from Britain to Canada, with scarce contact with family, friends, and mentors back home. But before I left, Professor Dong wrote me a "letter of reference" to be delivered to the eminent Professor Tsujii, who was then Department Head and director of the Computational Linguistics Center at UMIST (Tsujii was a student of the Japanese MT pioneer Nagao Makoto and the advisor of Li Hang). Professor Dong also wrote multiple recommendation letters for my other study-abroad applications. On the eve of my departure, it was Professor Dong who told me — he said Professor Liu Zhuo had confided that the project had kept Wei around for several years, causing him to miss several opportunities to study abroad. This time, with the British scholarship, they couldn't hold me back any longer — they decided to let me go. He encouraged me to go abroad and pursue deeper learning.

I also remember, before I went abroad, Professor Dong once gathered Chen Zhaoxiong and a few of us for a gathering and said (paraphrasing): "Right here we have the elite of Chinese MT. Can we consider coordinating and collaborating, truly building something together?"

By the time I transferred to Canada for my doctoral studies, Professor Dong had moved to Singapore. I can't recall how we reestablished contact, but in any case, when Professor Dong served as chair of the 1996 International Conference on Chinese Computing, he gave me the conference's overseas sponsorship to encourage my participation. In truth, my doctoral research on HPSG Chinese parsing was a niche exploration — essentially a toy system with little to show for it. One of Professor Dong's students working with him on a project in Singapore at the time was Guo Jin, whom I met at the Singapore conference. Later, when I joined JD.com and invited Guo Jin to be my partner, Professor Dong told me: "The two of you come from different backgrounds but share the same philosophy — you couldn't ask for a better partnership." Later, Guo Jin and I co-authored an NLP booklet, Natural Language Processing Q&A (Commercial Press, 2019).

As I've said before, although Professor Dong was not my direct advisor, his guidance, care, and encouragement over the years effectively made him my unofficial mentor. I was extraordinarily fortunate to encounter such a senior figure — from the very start I believed in him and followed him. In the 1980s, I assiduously studied his treatise on Logical Semantics, a masterpiece that can be regarded as the overture to HowNet.

The long article I translated — "The Pendulum Swung Too Far," which chronicles the struggle between rationalism and empiricism in NLP — was first recommended to me by Professor Dong. It was also Professor Dong who introduced me to contact Professor Church in person. The frequent correspondence among the three of us before and during the translation, and his corrections, is itself a long story.

Professor Bai Shuo's WeChat group "Semantic Computing" gathered a cohort of fellow researchers and experts in Chinese NLP and semantic studies. Under Professor Bai's leadership, the discussions on symbolic semantics ran deep, and the topics naturally often touched on Professor Dong's HowNet. It occurred to me to introduce Professor Dong to the group. I knew he had a special interest in these topics and had often seen him discussing related matters on LinkedIn. I thought he would surely be interested in what we often discussed. So I reached out and asked. Professor Dong hadn't used WeChat much before, so I consulted with Dong Qiang and his wife. They agreed — they felt it would be good for Professor Dong to take part in our NLP discussions, beneficial for his well-being, and we younger ones would of course be fortunate to benefit. So we first tried having Professor Dong observe the group using Dong Qiang's ID. Eventually, everything fell into place, and he joined. Many in the Semantic Computing group were his students, colleagues, and admirers — everyone was delighted. With Professor Dong's participation and teaching, the group's discussions reached greater depth. In the two years he was in the group, we shared a rare and precious stretch of direct interaction with the master. Professor Bai said:

"Professor Dong's exchanges in this group have contributed invaluable spiritual wealth to us. Whether in explicating HowNet's top-level design principles or evaluating the latest advances in NLP, his golden insights poured forth, awakening and inspiring us. This group has lost a giant among its members. The topics Professor Dong discussed here deserve our long-term contemplation as we integrate them with our own study and work. Professor Dong was always sharply perceptive about ontology — I always felt he had profound insights he hadn't yet articulated. To have thought, a full decade or more ago, of moving beyond taxonomy at the ontological level toward something akin to today's event knowledge graphs — that is true visionary thinking."

Once, in the group, I made a self-deprecating remark about the shortcomings of symbolic systems, unintentionally offending Professor Dong — who was, after all, a standard-bearer of symbolism. It was the first time he openly scolded me, calling me "pretentious." I felt at once awed and admonished, like a disciple receiving a master's stern instruction. The only people whose rebukes I could accept without retort were Professor Liu and Professor Dong — not even the King of Heaven himself. Professor Dong was a sage in my heart. Before him, even to have my brains dashed out would have been worth it. He didn't need to always be right; he could be stubborn, he could be mistaken — but a great man is a great man. The very existence of him and his thought was an authority. My generation could only gaze upward, out of reach. My mentor is gone, and my heart is adrift.

To the very end, Professor Dong was always debugging systems, probing the mysteries of the human mind and language. I imagine Heaven must have computers too — God would never let him be idle. HowNet is not only the spiritual legacy he left us; it will shine gloriously in the celestial realm as well.

Selected Sayings of Professor Dong:

1. "We have grown old, but machine translation is still young."

2. "In this life, I have done two things: one that others were unwilling to do, and one that others were incapable of doing."

3. "Rule-based machine translation is a fool; statistical machine translation is a madman."

— Written on March 29, 2019


朝华午拾 · 第十六章:哭送语义宗师董振东先生

2019年噩耗传来的时候,我正在路上,震惊莫名,感觉脑袋嗡嗡的。当时我刚下高铁,是我老爸最先传来的消息,比各群都早。老爸肯定是关注了中国NLP最高学术团体中文信息学会的新闻。他也常听我谈起过董老师。

老友尼克提议我别忘了写纪念文章。追随、受惠于先生三十载余,心中的怀念,千头万绪,从哪儿说起呢?

89风波后不久,第二届机器翻译高峰会议在德国慕尼黑举行。我代表刘倬老师在会议上介绍了我们的翻译系统,董老师也在场。会后,我们应邀去荷兰BSO公司的多语机器翻译小组,参加他们的 Chinese week,讨论把中文加入到他们多语计划中的议题,以及探讨中文处理的挑战。

很多年后,董老师给我来信说,孩子们整理老照片,翻出来一张在荷兰的合影,感觉很珍贵。Witkam 就是照片上的BSO项目组长,当年是他从欧共体争取到机器翻译项目的基金,BSO公司补齐另一半,这才成就了他们以世界语为媒介语的多语言机器翻译项目的五年计划。其中的中文部分就是我为他们做的依存关系文法(全是纸上谈兵的一套,但也勾画了中文形式化的雏形)。当年董老师对我的这个工作赞许鼓励有加。

我也回寄了一张在高立公司一起做机器翻译项目期间的临别合影。高立公司那段是个机缘,我得以与董老师在地下室改造的办公室相处几个月,亲聆教诲。

那是 2013 年四月,董老师回信说:

谢谢。对我们而言都是非常珍贵的照片。那年我已54岁,但体力脑力还不错。又一个20年过去了。我还在想再挑战自己一把。至少我会把我们的基于HowNet的机译系统,一直做下去,看看最后会到一个什么程度。上次回去领奖时去看望了刘老师,他提及所里建议他还是再带学生。他觉得没有课题,经费不好弄,他没有应承。我回来想了想觉得他也许还是干点什么好。也许会开出个什么新天地。

最近接到学会来信,2013年的计算语言学大会,看了他们的征文内容,觉得想说点什么,等我写了,也给你转去,供参考。

家里热闹了一番吗?女孩大了,不好太管。

振东

我的回复:

2013/4/27

那应该是 HowNet 的酝酿阶段,记得您当时提过几次设想。

上次您提到可以用一些细致分类去解决结构歧义(PP-attachment 类的问题)。也许仔细做是可以的,但是我觉得结构歧义的根本出路不在人工的 taxonomy,而在统计:因为结构歧义说到底是三角恋爱,最终谁与谁结合决定于语义拉力的相对力量对比,而这种AC与BC相对的拉力是无法事先计算出来的,因为有太多组合的可能性。但是,AC 或者 BC 各自的拉力是可以通过大数据事先学习出来的(本质上是 lexical coherence acquisition)。只要有一种机制让这种统计信息在结构歧义的现场提出来做对比,理论上可以解决这个问题。这比用细致的语义特征去人工调试应该有效合理一些。

事实上,这种机制目前已经可以实现。当然实现起来还有些繁杂,代价还需要考察。

这次看望刘老师,感觉还是苍老、迟缓很多。估计他也没有足够力气了。我理解您的意思,搞了一辈子科研,即便退休,最好也别完全停下来,除非有别的爱好。可惜的是,我们很多人除了做系统,都没有什么其他爱好。退休生活容易寂寞。

学生:维

与董老师长达30多年的交往,除了生活上的问候外,我们谈的最多的还是专业。董老师是性情中人,富有幽默感,常让人忍俊不禁。记得当年谈到他的译星,董老师说那才真正是自己的孩子,呕心沥血的结晶。接着笑道:儿女不算,为啥?那是"自然灾害"的结果。可是很多年以后,他又跟我说到孩子的话题,希望我有机会带董强一起干一番事业,列举孩子的优点缺点。最后不忘补一句,自己的孩子,瘌痢头也是好的。

在中国机器翻译的历史中,我的导师是开创者:刘涌泉老师1957-1958年开始组建团队,从外语学院挖来了刘倬老师,还有一位早逝的高祖舜老师,1959年第一次实验成功,三人后来合著《机器翻译浅说》一书(日本从事MT研究的时候作为主要参照,译成了日语)。董老师应该是60年代的某个时间点,作为黑龙江大学外语系的老师,参加了二刘老师的MT项目。董老师对两位亦师亦兄的刘先生非常尊重,前几年还跟我提到曾分别去看望两位,表达敬意。

董老师青出于蓝,后来在军科院率先把MT落地为开放型软件,成为中国MT和NLP的领军人物之一。从国际交流来看,董老师在很长的时期是中国NLP的大使,是与国际学界的接口。董老师从军科院的"科研一号"实用开放型英汉机器翻译原型系统,到中软真正落地,推出第一款商品化软件"译星"(TranStar),给当时全国近十个MT团队做出了榜样:MT 可以走出实验室。

译星是一个里程碑。

董老师后来跟我说过其中的经验体会。最主要一条就是不能原地打转,要抓大放小,研发到一定的阶段,迅速扩大测试集,开放系统给其他人测试,在错误中成长。译星之前的研发,实际上都是在非常小的开发集上做,当年也不区分开发集与测试集,系统通常也不开放。所谓的学术成果鉴定会,大多在一个封闭集中,抽取几个样例进行。以前的机器条件也差,常常是输入一个句子,鉴定组成员出去喝了咖啡回来才能看到结果。董老师的"科研一号"鉴定会是第一次把系统开放给评委专家来测试的事件。这在当年是需要底气和勇气的。我还清楚记得跟着刘老师去军科院参加"科研一号"系统评测的情景。礼堂外展示了系统的过往翻译样品和系统说明。礼堂内专家们用不同的句子挑战系统。对于系统的开放测试,印象非常深刻。

董老师与台湾的苏克毅教授关系很好。董老师跟我说,你看,苏教授自己凭着对MT的热情开了家翻译公司,软件虽然做得并不精细,但他敢于大胆使用,不断迭代。

80年代末,高立公司来找刘老师合作,决定根据刘老师的 JFY-IV型专家词典为基础的 MT 来做新一代机译产品。那时候,我们已经从董老师的开放实践中学会了放开脚步。此前我们为几百句可以反复打磨一两年。

董老师自己也承认,从设计上,刘老师的专家词典系统比"译星"更胜一筹,更具有潜力。他也受邀参与了高立的计划,但那时候,他的重点已经有转移,开始酝酿《知网》(HowNet)了。我还清楚地记得,我们吃午饭闲聊的时候,董老师说,他觉得机器翻译的基础知识资源不足,需要从根子上加强语义本体知识,包括常识。这一做就是30年!

说一下这个项目的国际学术背景。董老师做机器翻译用的是著名语义学家费尔默的深层格(deep case)语法框架,董老师做了适当改造,起名叫逻辑语义。他用这个框架作为机器翻译和转换的内部结构(中间语言),发表了几篇有相当影响的论文,证明这个表达足够深入,对于不同语系的语言之间翻译也很合适(如,董振东:逻辑语义及其在机译中的应用)。我当时也对深层格理论着迷,很信服董老师的工作(这个影响一直延续至今,这就是我一直强调深层解析是 NLP 核武器的主要渊源)。但是逻辑语义有了合适的图结构表示之后,只是解决了结构层面的语义关系,而节点语词概念的语义本体知识没有跟上来配合构成完整的知识体系。其中最重要的本体知识包括谓词子范畴的潜在句型,及其所要求的算元类型及其角色。例如,谓词EAT的子范畴句型要求两个算元,一个要求人或动物,逻辑语义角色是逻辑主语,另一个算元是逻辑宾语,要求是食品。这实际上是常识,需要本体知识库把常识形式化。

于是,《知网》对跨语言概念精细分类,以义元及其关系为人类常识编码,建立了一个形式化的本体知识体系和逻辑语义表示。它是非人力可为的天才杰作,是上帝之光对董老师的眷顾,是中国对人类文明的贡献。圈子里都说深度神经三位先驱者坐了20-30年冷板凳,终于迎来了图灵奖(见《图灵奖颁给熬过寒冬的人》)。董老师坐了30多年冷板凳,还基本上是藏在深山人未识。《知网》未必不是一个图灵级别的对于人类认知的贡献。我相信,将来某个时候,当机器翻译和自然语言理解的应用项目穷尽了浅层可用的低枝果实之后,知识系统将会被进一步发掘、利用和欣赏。

当年,WordNet 已经存在了,不过那套体系是心理学家主导的,有很多不对劲的地方。这种词典概念的体系是一个很苦的活儿,没人愿意做,也很少人有能力做,而且有能力也愿意了,能坚持做下去,完成这个巨大工程也非常人可为。虽然 WordNet 根本就不是为 NLP 或 MT 而设计的,然而,用无可用,大家做系统做到一定深度需要调用语义资源的时候,还是去用它,或者改造它来用。到了董老师这样的学养和深度,他不愿意将就,他有自己的体系设计和自信。他要推倒重来,按照自己的设计,做一个更适合机器翻译和NLP的本体知识库出来。

这类工作非圣人巨匠不能。本体知识体系的学问门槛很高,涉及包罗万象的基本概念、关系和常识。即便自以为有了一个逻辑自洽的比较合理的体系架构,里面的工作也繁难无比。

《知网》是董老师的不朽丰碑。

我91年出国以后,就流浪天涯了,从英国到加拿大,与国内的亲友和师长都难得联系。但出国前,董老师给我写了个"介绍信",交给在UMIST担任系主任和计算语言学中心负责人的大名鼎鼎的Tsujii 教授(他是日本MT元老长尾真的弟子,李航的导师)。董老师还为我其他的留学申请多次写过推荐信。出国前夕,是董老师告诉我的,说刘倬老师跟他说了,项目把立委留下来好几年了,错过了几次留洋机会。这次的留英奖学金机会,不好再留了,决定放人。鼓励我出国好好深造。

记得还在我出国前,有一次董老师召集陈肇雄和我们几个人一起聚会,说(大意):咱们这里都是中国MT的精英了,我们可以不可以考虑协调合作,实实在在做一番事业。

等我转到加拿大念博士的时候,董老师已经到新加坡了。记不得怎么恢复的联系,总之董老师作为1996国际中文计算会议主席召集大会的时候,为鼓励我参会,把大会的海外赞助给了我。其实,我博士时期的 HPSG 中文研究,属于小众的探索,基本上就是玩具系统,并没有多少拿得出手的东西。当时跟董老师在新加坡做项目的弟子有郭进,新加坡会议我们相识。后来我加入京东的时候,请郭进过来搭档,董老师跟我说你们俩背景不同,理念一致,搭档做事真是再好不过了。后来,我和郭进合作发表了一本NLP小册子《自然语言处理答问》(商务出版社,2019年)。

以前说过,董老师虽然不是我的直接导师,但多年来对我的指引、关照和鼓励,实际上是编外导师了。总之非常幸运能遇到这样的前辈,从一开始就信服他、追随他,80年代就刻苦研读他的逻辑语义学说(董振东:逻辑语义及其在机译中的应用),这篇杰作可算是《知网》的序曲。

我翻译的反映NLP领域理性主义与经验主义两条路线斗争史的《钟摆摆得太远》长文,就是董老师最先推荐给我的文章,也是董老师介绍我联系 Church 教授本尊。翻译前后我们三人间的频繁通信以及他的指正,也是一大篇故事。

白硕老师的微信群"语义计算"聚拢了一批中文NLP及其语义研究的同仁和专家,在白老师的带领下,探讨符号语义很深入,话题自然也常常涉及董老师的《知网》。于是我想到了介绍董老师入群。我知道董老师对于这些话题特别有兴趣,也常见他在领英里面与人讨论相关话题,想他对我们常讨论的内容一定会有兴趣的。于是尝试联系询问。董老师以前不怎么用微信,我就跟董强夫妇商量。他们也很同意,觉得董老师如果能参与我们的NLP话题,是很好的事情。对于董老师身心健康也有好处,我们后辈自然也有幸受益。于是先尝试让董老师用董强的ID入群观察,最后水到渠成,他就加入了。语义群里很多是他的学生、同事和仰慕者,大家都很高兴。有了董老师的参与和教诲,群里的讨论更有深度。董老师入群的两年里,我们共同度过一段与大师直接互动的难得时光。白老师说:

"董老师在本群的交流中为我们贡献了宝贵的精神财富,无论在解说HowNet的顶层设计思路方面,还是在评价NLP最新进展方面都是金句叠出,振聋发聩。本群失去了一位巨匠级的群友。董老师在群里交流的那些话题值得我们结合各自的学习工作实际,长久体悟。董老师对ontology一直很敏锐,总觉得他有高见没有说出来。能早十几年就在ontology层面不满足于taxonomy而想到去做类似当今事理图谱那样的东西,真的是高屋建瓴。"

有一次在群里我对于符号系统的短板来了点自嘲,没想到无意中触犯了董老师(董老师是符号主义的一面大旗)。那是第一次他当众批评我"矫情"。我当时的感觉是诚惶诚恐,耳提面命。这样的奚落,除了刘老师和董老师,任他天王老子,我大概很难不反唇相讥。可董老师是我心中的圣哲,在他面前,肝脑涂地也是值得的。高山仰止,说的就是这个意思。他不需要总是正确,他也可以固执、错怪,但伟人就是伟人。他和他的思想的存在本身,就是一种权威。我辈望尘莫及。恩师已去,我心恍惚。

董老师一直到老,始终在调试系统,探究人脑和语言的奥秘。我想天堂应该也有电脑,上帝不会让他闲着,《知网》不仅是他留给我们的精神遗产,也会在天国大放异彩。

董老师语录摘要:

1)"我们老了,但机器翻译还年轻"。

2)"我这一辈子做了二件事,一件是别人不愿做的事,一件是别人做不了的事。"

3)"规则的机器翻译是傻子,统计的机器翻译是疯子。"

记于2019年3月29日


From 朝华午拾 (Morning Glory & Afternoon Memories). Original Chinese: 第十六章:哭送语义宗师董振东先生.

发布者

立委

立委博士,多模态大模型应用咨询师。出门问问大模型团队前工程副总裁,聚焦大模型及其AIGC应用。Netbase前首席科学家10年,期间指挥研发了18种语言的理解和应用系统,鲁棒、线速,scale up to 社会媒体大数据,语义落地到舆情挖掘产品,成为美国NLP工业落地的领跑者。Cymfony前研发副总八年,曾荣获第一届问答系统第一名(TREC-8 QA Track),并赢得17个小企业创新研究的信息抽取项目(PI for 17 SBIRs)。

发表回复

您的邮箱地址不会被公开。 必填项已用 * 标注

这个站点使用 Akismet 来减少垃圾评论。了解你的评论数据如何被处理