Bits Meeting Atoms through Waves: How to Create Mobile Media Services :Bits Meeting Atoms through Waves: How to Create Mobile Media Services Prof. Michael Lyu Principal Investigator of VIEW Technologies Department of Computer Science and Engineering The Chinese University of Hong Kong


Bits Meeting Atoms :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Bits Meeting Atoms Concerning how electronic information overlaps with the everyday physical world Bits -> information Atoms -> human being Overlaps -> through media Book, newspaper TV, radio Internet, wireless & mobile


Moving Bits Around :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Moving Bits Around Traditional economy moves atoms around by demand for goods e.g. Logistics Information economy moves bits around by demand for information e.g. Financial activities Emerging mobile industry delivers bits to meet atoms through waves by demand for communication via rich media e.g. Mobile media services


Bridging the Gaps: The Brave Marriage :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Bridging the Gaps: The Brave Marriage Mobile network is from Mars Limited bandwidth Media services is from Venus Enormous bits Mobile media service means Need to utilize most bits that meet the atoms Transmit the most “important” bits Content sensitive User sensitive


Fittest Bits Survive :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Fittest Bits Survive Which bits are important? Bits representing stock price Bits in a speech mention the stock price Bits representing the name of a place Bits in a picture of a map Bits representing the name of a person Bits in a picture of a face Knowledge rules Domain- and user-specific


Media Information Processing :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Media Information Processing Under domain-specific context Applying knowledge to recognize Characters, human faces, speeches, objects Using summarization techniques to Discover the key points Finding similarities Information mining Extracting important bits


Video over InternEt and Wireless (VIEW) Technologies :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Video over InternEt and Wireless (VIEW) Technologies New technologies and applications to support delivery of video over Internet with mobile access capabilities Video information processing and presentation Wireless/mobile applications development and deployment


i-VIEW System :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong i-VIEW System Collaboration with CMU Informedia Project An intelligent system for Video over InternEt and Wireless delivery Multilingual and multimodal video content management and delivery techniques Software enabling schemes for content creation, information summarization, dissemination, and wireless access An open-standard multimedia content hub and exchange framework for various applications


Functions of i-VIEW :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Functions of i-VIEW Large scale video storage Video, audio, image and text based search engines Multi-lingual capability (English + Chinese) Internet and wireless accessibility Open standard Interoperability


i-VIEW: Video Information Processing (VIP) :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong i-VIEW: Video Information Processing (VIP) Speech Recognition Video OCR Text Topic Summary GeoCode Time & Date Scene Detection Face Recognition Logo Recognition


Video Information Processing (VIP) :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Video Information Processing (VIP) An integrated environment for video information processing with interactive and batch processing capabilities. Video Summary (Scene Change) Video OCR Transcript generation (Speech Recognition) Static logo detection


i-VIEW Desktop Client :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong i-VIEW Desktop Client


Wireless Deployment :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Wireless Deployment


i-VIEW Wireless PDA Client :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong i-VIEW Wireless PDA Client Transcript Map Streaming Video Text query box Bluetooth Compact Flash (CF) Card Bluetooth Access Point


Automatic Video / MMS Conversion :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Automatic Video / MMS Conversion Multimedia Messaging Service Contain pictures, sound clips, text Limited to around 100KB Applying VIP techniques to Identify “important shots” Skim for “important speeches” Recognize “important text”


Automatic Video / MMS Conversion :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Automatic Video / MMS Conversion Video “Important Shots” Summarization techniques


Conclusions :Video over InternEt and Wireless (VIEW) Technologies The Chinese University of Hong Kong Conclusions Mobile media services require content creation techniques and mobile application platforms Content Creation Techniques Automatic Effective – high accuracy Efficient – fast performance Mobile Application Platforms Heterogeneous carriers Interactive services A brave new world can be expected when bits meet atoms through waves with successful deployment of mobile media services