Lecture 01: Introduction: Lecture 01: Introduction IS246 Multimedia Information Prof. Marc Davis UC Berkeley SIMS Monday and Wednesday 2:00 pm – 3:30 pm Fall 2004 http://www.sims.berkeley.edu/academics/courses/is246/f04/


Today’s Agenda: Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time


Today’s Agenda: Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time


Who Am I?: Who Am I? Assistant Professor at SIMS (School of Information Management and Systems) Background


Why Am I Here?: Why Am I Here? Creating technology and applications that will enable daily media consumers to become daily media producers Research and teaching in the theory, design, and development of digital media systems for creating and using media metadata to automate media production and reuse


Student Introductions: Student Introductions Who are you? Name Undergrad degree and current department Special areas of expertise and interest Why are you here? What you want to learn from the course


Today’s Agenda: Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time


Global Media Network: Global Media Network Digital media produced anywhere by anyone accessible to anyone anywhere Today’s media users become tomorrow’s media producers Not 500 TV Channels — 500,000,000 multimedia Web sources


What is the Problem?: What is the Problem? Today people cannot easily find, edit, share, and reuse media Computers don’t understand media content Media is opaque and data rich We lack structured representations Without content representation (metadata), manipulating digital media will remain like word-processing with bitmaps


Types of Multimedia Data: Types of Multimedia Data 1D Audio (speech, music, sound effects, etc.) MIDI 2D Photographs Graphics 3D Video (2D + Time) Animation (2D + Time) Computer graphic models 4D Computer graphic model animation (3D + Time)


Moore’s Law for Cameras: Moore’s Law for Cameras 2000 Kodak DC40 Nintendo GameBoy Camera $400 $ 40 2002 Kodak DX4900 SiPix StyleCam Blink


2004: Nokia 7610 Phone: 2004: Nokia 7610 Phone Integrated megapixel (1152 x 864 pixels) camera Integrated video recorder with audio function and 4x digital zoom for video clips up to 10 minutes long 65,536 color-display, 176 x 208 pixels Bluetooth wireless technology and USB connectivity Advanced XHTML browser 8 MB internal dynamic memory and 64 MB Reduced Size MultiMediaCard (MMC) Downloadable Java™ MIDP 2.0 applications


The Media Problem: The Media Problem Vastly more media will be produced Without ways to manage it (metadata creation and use) we lose the advantages of digital media Most current approaches are insufficient and perhaps misguided Great opportunity for innovation and invention Need interdisciplinary approaches to the problem


Today’s Agenda: Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time


Goals of the Course: Goals of the Course Acquire theoretical and practical foundations to analyze, design, and produce multimedia information systems Media theory Media practice Current and future media systems and applications Learn to apply media theory to media design Gain further experience in project-based learning and teamwork Develop an enduring framework and methodology for media analysis and design


What This Course Is: What This Course Is Graduate level lecture/seminar/studio in multimedia information Highly interdisciplinary Information Management and Systems, Computer Science, Electrical Engineering Film Studies, Cognitive Science, Linguistics Film Practice, Design, HCI Project-based and team-oriented Requires stretching, commitment, and active participation


What This Course Is Not: What This Course Is Not Topics Computer science or engineering course on media signals and systems Film criticism course Advanced media production skills course Media networking, protocols, compression course Methods Exams


Who This Course Is For: Who This Course Is For Students from SIMS Film Studies EECS Law, Business, Journalism, Architecture Other departments Interested in Synergizing a variety of disciplinary approaches to a complex, important, and fascinating problem domain that will shape the future of human communication, technology, and culture


Today’s Agenda: Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time


Course Format: Course Format Most classes will be lecture/discussion sessions Lecture ~50 minutes Discussion ~30 minutes For each class two students will prepare discussion questions and help lead discussion Some classes will be working sessions Assignment 3 Overview and Ideation Annotated Storyboard Working Session and Crit Final Project Overview and Ideation Some classes will be student presentations Media Production and Theory Presentations Final Project Presentations


Course Overview: Course Overview Course phases Theoretical and practical foundations Current issues and methods The future of multimedia Course assignments Theory application Using a camcorder Short media production Final project


Course Sessions: Part I: Course Sessions: Part I Theoretical and practical foundations Communications theory and semiotics (Reddy, Iser, Barthes, Saussure) Formalist media theory (Bordwell, Kuleshov) Semiotic media theory (Metz, Eco) Integrating theory and practice (Eisenstein) Video production overview (Guest: Rachel Strickland) Audio production overview (Guest: Rachel Strickland) Theory and history of computation (Hillis, Winograd) Computational media theory (Manovich, Dorai & Venkatesh, Bloch)


Course Sessions: Part II: Course Sessions: Part II Current issues and methods Metadata for media (Davenport, Davis) Automated media analysis (Agrain, Jain, Foote -- Guest: Jonathan Foote) Multimedia journalism (Guest: Paul Grabowicz) Media asset management and reuse process (Christel, Dimitrova, Prelinger, Jenkins) Commercial editing systems (Adobe Premiere) Commercial media asset management systems (Virage) Research multimedia systems (FotoFile -- Guest: Abbe Don) Research multimedia systems (Informedia – Guest: Michael Smith) Multimedia standards (MPEG-7)


Course Sessions: Part III: Course Sessions: Part III The future of multimedia Future of multimedia information technology (Bush, McLuhan, Davis, Chang) Active capture (Davis, Nack, Barry) Adaptive media (Davis, Stern, Varian) Mobile Media (Naaman, Sarvas, Toyama) Final project presentations


Course Assignments: Course Assignments Theory application Using a camcorder: “Object lesson” Short media production Annotated storyboard and goal statement Rough edit Presentation Final project Team and idea formation Project proposal Project design specifications Project presentation and write-up


Grading: Grading 20% Theory Application Assignment 20% Mini Media Production Project 40% Final Project 20% Class Participation


SIMS Digital Media Studio: SIMS Digital Media Studio Hardware Terabyte file server Gigabit Ethernet 2 Mac G4 workstations 2 PC workstations Various audio/video input options 5 Sony DCR-TRV50 DV camcorders 5 Audio field recording packs Greenscreen Software Adobe Premiere Adobe AfterEffects Adobe PhotoShop FinalCut Pro Media Streams Collaboration tools Brainstorming area Wall whiteboards


Office Hours: Office Hours Marc Davis Thursdays 1:00 pm – 3:00 pm And by appointment Ryan Shaw TBA


Today’s Agenda: Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time


Purchase Course Materials: Purchase Course Materials Purchase Course Textbooks David Bordwell and Kristin Thompson. Film Art: An Introduction. 7th Edition. McGraw Hill, New York, 2004. W. Daniel Hillis. The Pattern on the Stone: The Simple Ideas That Make Computers Work. Perseus Books Group, New York, 1999.


SIMS/CIS Computer Orientation: SIMS/CIS Computer Orientation See Ryan Shaw about Filling out SIMS/CIS Account Request Form Seeing Roberta Epstein on the second floor of South Hall to get SIMS/CIS orientation


Readings for Next Time: Readings for Next Time Wednesday 09/01 Michael Reddy: “The Conduit Metaphor: A Case of Frame Conflict in Our Language about Language” (Brooke) Wolfgang Iser: “The Reading Process: A Phenomenological Approach” (Geoff) Roland Barthes: “The Death of the Author” (Rebecca) Roland Barthes: “From Work to Text” (Sarah)


In Class Writing: In Class Writing marc@sims.berkeley.edu ryanshaw@sims.berkeley.edu What is multimedia information? What are the main challenges in multimedia information systems?