Overview : Overview Neil Trevett Senior VP Market Development, 3Dlabs President, Khronos Group Chairman OpenGL ES Working Group
Rich Media Market Opportunity : Rich Media Market Opportunity Handhelds becoming capable of playing rich media
New rich media features increase number of applications and users
Khronos API standards enable media acceleration
Without standards market growth is slowed 80’s Workstations 90’s PCs 00’s Handhelds
Increasing Cell Phone Functionality : Increasing Cell Phone Functionality Mobile media capabilities sell more handsets 2003 2004 2005 Nov’02: Nokia ships 50M imaging phones in ‘03
Dec’03: ALL NTT DoCoMo 3G phones have imaging ARC Market Analysis 2003-2008:
Over 40 cellular operators worldwide have launched mobile video services, thanks to technology advances, color screens, cameras, advanced media processors and increased memory storage…. VisionGain Report: Wireless Gaming 2002-2007:
Currently 5M wireless game users in Europe - by 2005 this number is set to grow to an astonishing 130M
IDC Report: US Wireless Gaming Forecast Update 2003-2008:
Gaming will soon cross the chasm from early adopters to mass-market and grow to 34.7% of the US’ 190M users in 2008, resulting in 65M games players. Hundreds of Millions of Wireless Gaming Users? What will they Play?
High quality 2D and 3D Graphics is Key Imaging Video 3D Gaming
Media APIs Enable Market Growth : Media APIs Enable Market Growth An API is an agreement between hardware and software worlds
Enabling both - everyone wins (API = APPLICATION PROGRAMMING INTERFACE)
ISVs see reduced variability across multiple platforms
More software can reach market faster at a better level of functionality and quality
Hardware vendors can accelerate a large body of software
Adding value to their platform
Software Developer Hardware Provider An industry-standard media API enables any software to run on any conformant hardware
Creating Open API Standards : Creating Open API Standards Open Membership Any company can join Funded by membership dues Open Standards Royalty-free
Publicly available Cross Platform Including diverse handheld and embedded markets Industry Momentum Specifications, Conformance tests, Promotion and Education Khronos has a PROVEN reputation for the TIMELY creation of HIGH-QUALITY, ROYALTY-FREE standards Open Standard APIs for Embedded Rich Media Acceleration Khronos is NON-PROFIT. Our member’s business is selling PRODUCTS - NOT charging for a standard
Khronos Membership : 70 Companies working together in harmony to create media acceleration APIs Khronos Membership
Khronos Media Acceleration APIs : Khronos Media Acceleration APIs 3D Small footprint 3D Acceleration Media Engines – CPUs, DSP, Hardware Accelerators etc. Media Libraries
Video Codecs, Imaging and Sound libraries Etc. etc. Applications Media Frameworks E.g. OpenML, Symbian MDF, GStreamer, DirectShow, MMAPI 2D Vector Graphics Acceleration Low-level APIs to harness graphics hardware acceleration Media Framework to control and synchronize multiple media streams Graphics APIs Media framework interface and low-level primitives for media library operating systems and processor portability Khronos APIs work together to enable an extensive media processing capability
Khronos Participation Model : Adopter Packages Khronos Participation Model Promoters Adopters Ratified Specifications Implementers Conformance Tests and evaluation tools Anyone can download specifications and SDKs and implement royalty-free products Conforming products can use logo Openly and publicly distributed – free of charge Board decides strategy - what APIs, budget, ratification of specifications. $15,000 annual membership dues SDKs Free libraries, utilities, examples. Licensed for commercial use Contributors Any member can join working groups to produce specifications.
$3,500 annual membership dues A Working Group for
each API standard
Recent Khronos News : Recent Khronos News Khronos membership 70+ companies
Including many leading companies here in Korea
OpenGL ES 1.1 publicly released on schedule
To enable a new wave of 3D hardware accelerated cell phones
OpenML Open Source Program
Full ML and MLdc source to be released on Source Forge this month
OpenVG entering public review
Details on www.khronos.org
First OpenGL ES hardware accelerated cell phones beginning to ship
Cell phone market is currently running at 500M handsets a year
Within 3 years there will be more OpenGL ES machines than Direct3D machines
The Vodafone V602SH
- With full hardware OpenGL ES acceleration – in stores in Japan now The Nokia 6630 Symbian smartphone is now shipping and supports the OpenGL ES API P&C S3500 First GIGA Class 3 phone with OpenGL ES
The Industry Standard for Embedded 3D Graphics : The Industry Standard for Embedded 3D Graphics
Diverse Platforms Need 3D Graphics : Phones PDAs Hand-held Appliances Line-powered Appliances Consoles Diverse Platforms Need 3D Graphics Safety Critical Avionics Automotive Advanced Personal Computing Automotive console and heads-up displays Settop Boxes Entertainment solutions Life-critical displays
OpenGL ES API Standard : OpenGL ES API Standard Small-footprint subset of OpenGL
Created with the blessing and cooperation of the OpenGL ARB
Powerful, low-level API with full functionality for 3D games
Available on all key platforms
Royalty Free!!
Eliminate Redundancy Eliminate Workstation Functionality ARB Feedback and Ratification Embedded Focus Workstation Focus Strong functionality in a small footprint e.g. 50KB software engines
Driving Needs for OpenGL ES : Driving Needs for OpenGL ES Cell phone industry is the first major adopter Enable games to easily run on multiple platforms High-quality processing per pixel for small screens Hardware acceleration saves 90% of power POWER CONTENT QUALITY PRICE Low-cost chips and cores Complete software implementation at less than 50KB
OpenGL ES – Central to Mobile 3D : OpenGL ES – Central to Mobile 3D Cross platform, low-level graphics API standard C/C++ Applications Scenegraph APIs M3G (JSR 184) Middleware Libraries Games Engines Java Applications Hardware OpenGL ES
Engines Software OpenGL ES Engines Operating Systems Low-level 3D Graphics
API High-level Graphics
Libraries Applications Brings advanced 2D/3D graphics to a wide range of platforms “Close to the metal” API provides portability AND flexibility Usable by higher abstraction libraries J2ME Usable directly by applications
Fixed and Float Profiles : Fixed and Float Profiles Support for high-volume devices systems with no floating point is key
But need to prevent fragmentation between fixed and float applications
Common-Lite profile replaces all floating point calls with fixed point
Enabling applications to use just 16.16 integer math
Common Profile is a proper superset of Common-Lite
Has BOTH fixed and float versions of all entry points
Common-Lite applications run without modification on Common Profile Common Profile Common-Lite
Profile Full functionality – but just fixed point entry points to API for integer-only platforms Full functionality – with both float and fixed point entry points for code portability between profiles
EGL – Increasing 3D Code Portability : EGL – Increasing 3D Code Portability Application Code 3D Hardware Acceleration Native Operating System But operating system calls access platform resources - memory, processor threads etc. makes code non-portable OpenGL ES provides portable, cross platform, abstracted access to the 3D pipeline EGL abstracts graphics-related system resource calls – such as accessing screen windows. Makes 3D-related code cross-platform portable. Similar to GLX/AGL/WGL
OpenGL ES Adopters Package : OpenGL ES Adopters Package Enabling Evaluation, Implementation and Testing
Evaluate the API: fully operational OpenGL ES library
Includes full Gerbera™ executable for Windows from Hybrid
Implementation Insights: open source sample implementation
OpenGL ES layered over desktop OpenGL on Windows and Linux
Testing Functionality: source to Conformance Tests
Only Conformant products can use the OpenGL ES Trademark
A peer-review formal process raises the testing bar relative to desktop OpenGL
ISVs SHOULD DEMAND CONFORMANT PRODUCTS! LOOK FOR THE LOGO! Reliable, cross-platform graphics functionality!
Reduces ISV porting and support costs across a wide diversity of platforms
Conformant OpenGL ES Products : Conformant OpenGL ES Products So far – many more in development
OpenGL ES in Action : OpenGL ES in Action Java MIDP1.0 Nokia N-Gage MotoGP on
Accelerated OpenGL ES Increased visual quality, visual effects, screen resolution and frame rate – for less mW!! Before OpenGL ES
API Must Evolve at the Right Speed : API Must Evolve at the Right Speed 2004 2005 2006 OpenGL ES 1.0
3D running in software on CPU OpenGL ES 1.1
Enhanced 3D running on fixed-function hardware OpenGL ES 2.0 3D shaders running on programmable hardware – Fast enough to encourage and expose new capabilities Not too fast to prevent
widespread adoption Previous API generations continue to be used and deployed on diverse range of devices. OpenGL ES 2.0 does NOT obsolete OpenGL ES 1.0 and 1.1 Shipping Products
OpenGL ES and EGL 1.1 : OpenGL ES and EGL 1.1 Enabling new-generation, hardware enabled handsets
Delivered on schedule – enabling and encouraging industry progress
Khronos committed to annual API update at Siggraph last year
Backwards compatible with OpenGL ES 1.0
A superset of OpenGL ES 1.0 - Common and Common-Lite profiles maintained
OpenGL ES 1.1 Conformance Tests in three months
Formal peer review - sustaining API quality – vital for industry confidence and adoption OpenGL ES 1.1 Enhanced Effects Multi-texture Skinning
Particle effects Enhanced Power Efficiency Buffer Objects Swap Interval Power Events www.khronos.org/opengles/spec.html Enhanced Flexibility Dynamic State Queries so layered software can use OpenGL ES. Not just games anymore! Enhanced JSR 184 Support Sprite and background handling
OpenGL ES Roadmap : OpenGL ES 2.0 OpenGL 2.0 OpenGL ES 1.1 OpenGL ES 1.0 OpenGL ES Roadmap Update OpenGL ES every year by default
To expose rapidly developing handheld platforms capabilities
BUT ONLY introduce features with proven demand from ISVs or IHVs
Guarding against unnecessary bloat
Track and adapt developments in desktop OpenGL
OpenGL 1.3 OpenGL 1.5 Enabling software AND hardware implementations – including small-footprint, low-end fixed point platforms State-of-the-art shader programmability for embedded devices Widely available cross-platform 3D graphics API Full high-level shading language capability to harness the power of programmable hardware Mid-03 Mid-04 Mid-05 Increasing emphasis on enabling emerging fixed function 3D hardware
OpenGL ES Coding Challenge : OpenGL ES Coding Challenge The OpenGL ES Coding contest is now running!
Sample code and applications for OpenGL ES games, demos and screensavers
$100K in prizes!!
A license of dPVS, Hybrid Graphics visibility determination library (value $75,000)
Borland C++ BuilderX 1.5 Mobile Edition - courtesy of Nokia (value $8,000)
Subscription to JPR TechWatch (value $2,500)
3Dlabs Wildcat Realizm board (value $1,500)
And more!
See http://www.khronos.org/devu/opengles_challenge/
Accelerated Vector Graphics : Accelerated Vector Graphics
Mobile 2D Vector Graphics : Mobile 2D Vector Graphics Vector graphics are already used everywhere
Flash, SVG, PDF, Postscript, Vector fonts etc. etc.
Will appear in new-generation applications soon
Advanced browsers, advanced user interfaces, GPS, rich-media messaging
Extremely high-quality - perfect for small-screens
Sophisticated anti-aliasing and easy scalability
OpenVG – Accelerating 2D Graphics : OpenVG – Accelerating 2D Graphics OpenVG is a a low-level API for 2D Bezier-based vector graphics
With a focus on enabling hardware acceleration
NOT a competitor to SVG, Flash, PDF and Postscript
A complementary acceleration layer for that class of software Offload vector 2D graphics operation from the CPU for interactive performance Save power by running vector 2D graphics on hardware Hardware Acceleration for Vector Graphics Display high-quality 2D graphics and text on small-screen devices Provide SCALABLE 2D graphics for easy porting of content to different screen sizes
Fast Track Development : Fast Track Development Will be used in wide range of applications and vector-based libraries
That need low-level vector graphics primitives
Text packages, GPS, screen savers, HUDs on games, E-books…
Specification aimed for release early 2005
Specification review in 2004, Conformance tests before mid-2005
Applications 2D Hardware Acceleration SVG/Flash/ Font Package etc..
Media Library Portability : Media Library Portability
Complete Media Library Portability : Diversity of silicon processors Diversity of operating systems Complete Media Library Portability Media Engines CPUs, DSP, Hardware Accelerators etc. DL – “Development Level” Media Primitives – provide portability of silicon acceleration MPEG4 H.264 MP3 AMR OpenMAX IL Portability Across Operating Systems Abstracted interfaces for media libraries into OS media frameworks OpenMAX DL Portability Across Processors Hotspot primitives to enable easy porting across hardware architectures More Media Libraries IL – “Integration Level” Media Primitives – provide portability to different operating systems Application Operating System Media Framework Wide range of video codecs, image and sound libraries etc.
OpenMAX – Media Primitives : Combinatorial Problem OpenMAX – Media Primitives Combinatorial problem of hardware and software
Media libraries are typically LATE to market and POORLY optimized
OpenMAX defines standard collections of media “hotspot” primitives
To be implemented on multiple processors, platforms and architectures
Enables rapid PORTING and OPTIMIZATION of multimedia libraries
Video, audio, graphics, imaging etc.
A wide range of media acceleration silicon using many diverse architectures Optimized OpenMAX libraries supplied by silicon vendors for rapid porting of libraries across multiple accelerators An increasing number of multimedia API libraries for video, audio, graphics and images
OpenMAX Working Group : OpenMAX Working Group Specification will be open and royalty-free
Using Khronos reciprocal licensing IP model
Creating complete set of deliverables
Specifications, implementations, conformance tests
Available on wide variety of architectures and operating systems
To enable true media library portability
Encourage wide industry support and adoption
Khronos strongly committed to promote this important new standard
2Q04 3Q04 4Q04 1Q05 2Q05 OpenMAX Working group established. Public announcement to invite industry participation 1st OpenMAX face-to-face meeting Draft OpenMAX 1.0 specification completed Ratify and publicly release OpenMAX 1.0
Initial implementations available
Further Resources : Further Resources www.khronos.org
All presentations posted there
Public Forums
Get involved in the Khronos community
Specification Reviews
Sign-up for mailing list alerts for API draft reviews
DevU courses around the world
Free full day educational courses
Details on www.khronos.org/devu/index.html
We welcome enquiries from companies interested to join Khronos
Any Questions? : Any Questions?