kodak memory studio

The Kodak Memory Studiofeaturing the Sidekick Virtual Assistant: 

The Kodak Memory Studio featuring the Sidekick Virtual Assistant A project by the Carnegie Mellon University Entertainment Technology Center for the Kodak Systems Concept Center Summer 2003

Introductions: 

Introductions The Memory Studio and Sidekick were developed by a team of graduate students at Carnegie Mellon University’s Entertainment Technology Center Cecile Galea Patrick McKiernan Eben Myers Gabriel Sabourin Ben Smith Tom Smith Jichen Zhu Don Marinelli, Faculty Advisor

The Entertainment Technology Center: 

The Entertainment Technology Center Interdisciplinary program bringing together fine artists and technologists to create new processes, tools and vision for storytelling and entertainment Project-based program of study. Offers the only Masters of Entertainment Technology degree in the world.

Overview: 

Overview Introduction Demo In Depth Description Technology Evaluation Recommendations Future Development Questions

Introduction: The Problem: 

Introduction: The Problem The Problem (as presented to the ETC at the beginning of the project): Kodak has documented customer desire for customized products (such as framed prints, calendars, bound albums, story albums, and so on) built from digital images. However, there are significant obstacles to the creation of these custom products. People won’t put in the effort to build customized products. So far, attempts to understand and eliminate these obstacles have fallen short.

Introduction: Our Charge: 

Introduction: Our Charge The ETC brings Our fresh energy Our creativity Our own unique perspective We are to: Develop the process through which a user navigates to construct a customized product for purchase. Remove obstacles to creation. Make the process more fun/engaging/compelling.

Introduction: Our Solution: 

Introduction: Our Solution The Kodak Memory Studio Hybrid 2D and 3D interface Evokes physicality of the product Provides intelligent automation of product building Provides intelligent suggestions for editing individual pictures The Sidekick Virtual Assistant An animated character with personality Assistant, tutorial, and advisor all in one Powerful within the interface Conversational interaction with guest Provides a face for the automation processes

Demo: 

Demo Demo 1: An introduction to the Sidekick Demo 2: The Kodak Memory Studio

The Memory Studio: 

The Memory Studio Key Feature: Varying Level of Automation

How Automation is Achieved: 

How Automation is Achieved Design Intelligence Learning as much as possible about a set of images through image analysis Applying artistic rules and templates to those images User Profiling Every choice made by the user is recorded. Preferences and tendencies are noted, and future suggestions are influenced by the user’s past choices. Profiles are cross-referenced for more suggestions (i.e., if user A likes Thing 1 and Thing 2 and user B likes Thing 1, then maybe user B will also like Thing 2). Similar to Amazon.com recommendation system

Design Intelligence: 

Design Intelligence Advanced image analysis (learn as much artistically useful information about an image as possible) Face Detection Date Segmentation Detection of Dupes andamp; Duds Color analysis (is it a 'warm' or a 'cool' picture) Indoor/outdoor Landscape/portrait Dark or Light (and amount of contrast) More…

More on Design Intelligence: 

More on Design Intelligence Templates/Designs/Rules Define what relationships certain types of pictures should have to each other Example: Pictures with contrasting colors should be juxtaposed for maximum impact Should be developed in conjunction with artists Memory Studio will combine what it knows about the images with the specified rules and templates to create custom products.

Intelligent Suggestions for Fixing Photos: 

Intelligent Suggestions for Fixing Photos Advanced image analysis (identify traits that could affect how a photo should be or would need to be manipulated) Face recognition Indoor/outdoor Color analysis Warm vs. cool Color distribution andamp; composition Flaws: Red-eye, color balance, finger on lens Many more…

Intelligent Suggestions for Fixing Photos: 

Intelligent Suggestions for Fixing Photos Advanced automated image manipulation Color correction Intelligent cropping Get rid of fingers Crop in closer to faces and people for better portraits and group shots Red-eye removal Enhance More…

Situational Suggestions: 

Situational Suggestions Certain situations will have specialized suggestions Title pages Covers Pages with single pictures More… Artistic suggestions might include: Desaturate Sepia tone Tint Many others…

Text and Meta Data: 

Text and Meta Data As meta-data becomes available beyond the time/date stamp, this Design Intelligence will incorporate information about location, specific people, etc into its process. Captions may be able to be generated automatically.

The Sidekick: 

The Sidekick Introduction to Memory Studio interface Tutorials – Teaches while doing Can tell the user how or do it for them Puts a face on the intelligence of the system Represents the user in multi-user situations

Sidekick Activity: 

Sidekick Activity Sidekick introduces self and Memory Studio features on user’s first visit. User Profile stores user’s Sidekick interactions as well, allowing the Sidekick to tailor proactivity. For the 'generic' user, the number of suggestions made by the Sidekick will diminish over time. Users who tend to ask questions of the Sidekick frequently will find that the Sidekick will make more suggestions. Users who don’t use the Sidekick much will find the Sidekick much more passive.

Sidekick Design Principles: 

Sidekick Design Principles Sidekick Philosophy Kodak Sidekick : User :: Sidekick : Hero Sidekick is supporting character Personality Enough to be fun Shouldn’t get in the way of productivity Simplicity and Transcendence Conversation is limited, but relevant in each situation Has powerful solutions for specific problems

More Sidekick Design Principles: 

More Sidekick Design Principles Trust Sidekick should be seen as impartial and separate with regards to Kodak Sidekick shouldn’t ever do anything that could be perceived as selling Other characters (like the Kodak Lab Tech) can represent Kodak to emphasize the separation

Technology: 

Technology Current Technology Flash Swift 3D (renders 3DSMax files into Flash) Technology for the Future Image analysis and manipulation Automation framework Puts knowledge of photos together with design rules Conversation Engine Eidoserve

Evaluation : 

Evaluation Focus Group 6 'techno soccer moms' Discussed digital photography, albums, online services Showed early version of the demo Discussed reactions, specifically to the Sidekick and the idea of automation Needs expressed: Clearly wanted albums/scrapbooks Time was the biggest issue 'If I had somebody else to outsource it [the making of albums] to, I would.'

Focus Group Reaction to Automation: 

Focus Group Reaction to Automation 'It would save a lot of time and energy.' Would use the automation to get an album started then edit from there

Focus Group Reactions to the Sidekick: 

Focus Group Reactions to the Sidekick Would use Sidekick as tutorial and occasional help 'I could see where even if I [had] used [the Memory Studio], at a certain point, I’d be like, ‘I just uploaded these; they’re all from France; just do it quickly for me.’ And the Sidekick would do that for me.'

Focus Group Reactions to the Sidekick: 

Focus Group Reactions to the Sidekick Thought Sidekick would slow them down Felt like the choice of 'cute' characters indicated a condescending attitude Wanted 'No Sidekick' option Saw Sidekick as purely for tutorial purposes Didn’t like 'hip' talk from Sidekick Wanted more characters that they would identify with (liked Sylvia)

Recommendations: 

Recommendations Develop many different Sidekicks with varying amounts of personality to cater to different demographics (i.e., fun characters for kids, sensible characters for soccer moms, etc.) Tone down the proactive nature of the Sidekick Speed up Sidekick’s interactions Explain Sidekick more clearly Add 'No Sidekick' option Develop the automation Additional automated features might include batch color correction, advanced grouping based on face recognition, red-eye processing, etc)

Additional Recommendations: 

Additional Recommendations Additional desired features: Album-wide and per-page visual themes Clip art andamp; borders Non-standard image shapes (hearts, diamonds, etc) Sell single pages that can be inserted in a three-ring binder Automated color correction Sell physical items to go with album (charms, stickers, things that can be applied to the album by hand) to give a more authentic 'scrapbook' feel

Further Development: 

Further Development Development of design intelligence and automation Design and implement overarching framework Have artists design specific templates/themes/rules for 'attractive' content Implement image analysis algorithms Implement image correction algorithms Design and implement user profiling system

Further Development Continued: 

Further Development Continued Further exploration and development of Sidekick Design multiple characters with varied personalities Implement Sidekick customization system Extensive testing with many demographics Experiment with a variety of levels of personality and proactivity

Further Development Continued: 

Further Development Continued Multi-user interaction Multiple Sidekicks interacting with a single product Chat

Slide31: 

Further Development Continued: 

Further Development Continued Optimization of content for Flash in preparation for Web delivery Reduce filesize Add data-base capability through Cold-Fusion or other technology Develop ability to approximate dynamic 3D in Flash Integration with Ofoto (or next generation of Kodak online photo service)

Slide33: 

Questions? Many thanks to those who helped bring this project to fruition: Don Marinelli (Project Advisor, voice) Randy Pausch (ETC Co-director) Kenneth Berger (CMU HCII) Nicole Giammatteo (voice of Emma) Brenda, Anneke and Emma Harger (voices) Christina Contreras (voice)