From Speech to Real-Time Summary Highlights: Hong Kong’s First AI-Powered Media Assistant Supports the Financial Secretary’s Budget Speech for the Third Consecutive Year

[Hong Kong, 25 February 2026] – InnoHK Centre for Perceptual and Interactive Intelligence (CPII), in collaboration with Radio Television Hong Kong (RTHK), has deployed its AI-powered Real-Time Speech-to-Summary Media Assistant for the third consecutive year to enhance the live broadcast of the Financial Secretary’s Budget Speech. The technology converts speech into multilingual text and rolling summaries in real-time, making critical public information accessible to all audiences.

Pioneering Real-Time AI for Public Information Broadcasting

CPII Real-Time Speech-to-Summary Media Assistant provides real-time transcription, translation, and rolling summaries in text. During RTHK 32’s live broadcast of the Budget Speech, the multilingual AI system converts speech into on-screen text and concise, continuously updated summaries, with the option for further summarization. As Hong Kong’s first deployment of real-time speech-to-text and summarization technology in live broadcasting, the system transforms how audiences engage with essential public information—making it more timely, accessible, and actionable for diverse communities across the city.

Three Years of Enhancement: AI Technology for Live Public Communication

Built specifically for Hong Kong’s unique linguistic landscape, the CPII Real-Time Speech-to-Summary Media Assistant features a customizable speech recognition engine that seamlessly supports Cantonese, English, and Mandarin with dynamic key word updates and automatic error correction.

Drawing on insights from three years of deployment, this year, the AI-powered Media Assistant adds several new capabilities, including:

• Enhanced summary-point generation with automatic evaluation metrics for improved relevance and clarity
• Keyword-based error correction offering greater customization
• LLM-based translation support with customizable keywords
• Improved accuracy and user experience for simultaneous interpretation

Together, these enhancements deliver a smoother, more interactive viewing experience and strengthen large-scale communication to diverse audiences.

The continued partnership between CPII and RTHK demonstrates how academic research can directly serve public needs. By applying state-of-the-art natural language processing and machine learning techniques to live broadcasting, CPII is advancing both technological innovation and social accessibility.

About CPII

InnoHK Centre for Perceptual and Interactive Intelligence (CPII) was established by the Chinese University of Hong Kong in 2020 under the InnoHK initiative of the Innovation and Technology Commission of the HKSAR Government. Its research covers computer vision, multilingual speech and language technologies, natural language processing, and AI-enabled design automation. Through pioneering research and applications in its key strategic areas, CPII is dedicated to addressing global challenges to achieve social benefits in Hong Kong, Greater Bay Area and beyond.

For more information about CPII, please visit www.cpii.hk.
Email: contact@cpii.hk
Phone: +852 3692 6600