EVENTS

From Speech to Summary Highlights in Real-Time: Hong Kong’s First AI-powered Media Assistant Powers Financial Secretary’s Budget Speech for Second Consecutive Year

From Speech to Summary Highlights in Real-Time: Hong Kong’s First AI-powered Media Assistant Powers Financial Secretary’s Budget Speech for Second Consecutive Year

[Hong Kong, 26 February 2025] – For the second consecutive year, the Centre for Perceptual and Interactive Intelligence (CPII), in collaboration with Radio Television Hong Kong (RTHK), has revolutionized the live broadcast of the Financial Secretary’s Budget Speech using cutting-edge Artificial Intelligence (AI). Powered by CPII’s Real-Time Speech-to-Summary Meeting Assistant, this innovative AI technology delivers real-time transcription, translation, and rolling summaries in textual form – setting a new benchmark for live media broadcasting in Hong Kong.

This groundbreaking, multi-lingual AI system can transform spoken words into text and concise, AI-generated summaries displayed during RTHK 32’s live broadcast which can be further summarized. As the first-of-its-kind in Hong Kong, this AI-powered assistant is a breakthrough in real-time speech-to-text and summarization technology, making live broadcasts more accessible and informative for all walks of life in Hong Kong.

Latest AI Technology in the Most Demanding Context
The CPII Real-Time Speech-to-Summary Meeting Assistant deploys the latest advancements in AI tailored to Hong Kong’s multilingual environment. Its customizable speech recognition engine seamlessly switches between Cantonese, English, and Mandarin, with dynamic keyword updates and automatic error correction for improved accuracy. This year, this AI-powered Media Assistant introduces several new features, including:

  • Knowledge-based error correction for accurate, natural and polished transcriptions.
  • Scored AI summarization, ensuring only the most relevant insights are highlighted.
  • An AI Chatbot for interactive queries based on real-time transcriptions, enhancing audience engagement.
  • Mobile simultaneous interpretation, allowing users to view the summary highlights and listen to either the original speech or real-time translations.
  •  

These enhancements ensure a smoother, more interactive experience, a true breakthrough in mass communications to diverse audiences.

A Vision for Everyday AI
Professor Meng, Director of CPII, highlighted the significance of this innovation: “Our goal is to bring cutting-edge AI technologies into everyday applications that deliver real value to Hong Kong’s society. By enhancing accessibility and efficiency, we’re not only improving live broadcast but also laying the groundwork for broader adoption of AI-powered solutions in the Greater Bay Area and beyond. We look forward to finding more use cases and partners to continue advancing this vision.”

About CPII
The Centre for Perceptual and Interactive Intelligence (CPII), part of The Chinese University of Hong Kong, is at the forefront of AI research and innovation, driving advancements in Speech & Language Intelligence, Visual Intelligence, and AI applications for healthcare, urban services, and design automation. Funded by the InnoHK Scheme, CPII is committed to pioneering impactful AI solutions that bring value to Hong Kong, the Greater Bay Area, and China.

For more information about CPII, please visit www.cpii.hk.
Contact information: [Email contact@cpii.hk] [Phone +852.3692.6600]