HUCtalk 9 00

EasyLiving:Technologies for Intelligent Environments: 

EasyLiving: Technologies for Intelligent Environments Barry Brumitt, Brian Meyers, John Krumm, Amanda Kern, Steven Shafer

Slide2: 

Talk Outline EasyLiving Project Overview Critical Technologies Demo Applications

Ubiquitous Computing: 

Ubiquitous Computing Desktop Computing Mobile Computing Intelligent Environment Disaggregated Computing, Invisible Computing, Pervasive Computing, Ubiquitous Computing

Ubiquitous Computing Elements: 

Ubiquitous Computing Elements People Things Devices Computation Abstractions Applications andamp; Behaviors Abstractions

The EasyLiving Project: 

The EasyLiving Project EasyLiving is a prototype system for building intelligent environments Key Technologies Middleware Perception World modeling (geometry!) 3 researchers, 3 SDEs

Slide6: 

Talk Outline EasyLiving Project Overview Critical Technologies Middleware Perception Geometry Demo Applications

Ubiquitous Computing Needs Middleware: 

Ubiquitous Computing Needs Middleware Simplified application development Resource management across disparate heterogeneous devices Facilities for handling network partitioning (esp. mobile devices)

InConcert (now): 

InConcert (now) Messages passed asynchronously Messages marshalled into XML Machine-independent addressing …also being used by other projects at MSR

InConcert(coming attractions): 

InConcert (coming attractions) Discovery of new services Attribute-based service description Eventing (filters, etc.)

Slide10: 

Talk Outline EasyLiving Project Overview Critical Technologies Middleware Perception Geometry Demo Applications

Perception for Ubiquitous Computing: 

Perception for Ubiquitous Computing Who is in the room? Where? What is Joe doing? Where is Joe looking? What is in the room? Where? What devices are accessible to Joe? What is Joe pointing at? Who is speaking now? Typing now?

Person TrackingSystem: 

Person Tracking System

Person Tracking Example: 

Person Tracking Example More cameras = more coverage (video: 02:30 – 04:30)

Problem Dimensions(1): 

Problem Dimensions(1) number of people in view number of cameras Person Tracking Speech (for example) dictation continuous speaker dependent speaker independent talking speed speaker 1 2 3 n 1 2 3 n

Problem Dimensions(2): 

Problem Dimensions(2) none maintain recognize identity 0% 50% 100% occlusion stand stand andamp; sit stand, sit, lay postures one image video tape always on show canned sequence live demos naïve user real time

Keyboard Tracker: 

Keyboard Tracker Green dot indicates centroid of keyboard Rule: Route keystrokes to the session of the person in front of the keyboard.

Slide17: 

Talk Outline EasyLiving Project Overview Critical Technologies Middleware Perception Geometry Demo Applications

What is Geometry?: 

What is Geometry? Euclid’s Five Postulates A straight line segment can be drawn joining any two points Any straight line segment can be extended indefinitely in a straight line Given any straight line segment, a circle can be drawn having the segment as the radius and one end point as center All right angles are congruent If two lines are drawn which intersect a third in such a way that the sum of the inner angles on one side is less than the two right angles, then the two lines inevitably must intersect each other on that side if extended far enough. A pervasive mechanism for declaring, representing, and querying the physical relationship between people, places, devices, and things.

Geometric Model Benefits: 

Geometric Model Benefits Abstraction Layer Shared Metaphor with User Physical Parameters for UIs

Other Approaches to Location Context: 

Other Approaches to Location Context Semantic tags Outdoor Beacons: GPS/mobile-phone Indoor Beacons: RF, IR, ultrasonic Single coordinate frame Poor mapping to semantics Network Routing (connectivity=colocation) Avoids perception perils Confusing semantics

Model Fundamentals: 

Model Fundamentals Explicit uncertainty representation No 'favored' coordinate system or origin Geometry only, minimal semantics

Queries: 

Queries 2 Fundamental query types Entities’ relationship Region membership

Geometry(Coming attractions): 

Geometry (Coming attractions) Scalability andamp; performance Integration with semantic location tags Maps / floor plans, path planning Geometric discovery

Slide24: 

Talk Outline EasyLiving Project Overview Critical Technologies Demo Applications

Turning On The Lights: 

Turning On The Lights 'Turn on that light' [pointing] 'Give me light' Sit down Users prefer speech interfaces Gaze very helpful for interpreting specified device Geometric knowledge needed for speech understanding User study preliminary conclusions Flip a switch Dialog box with buttons Map with lamp indicators 'Turn on the room lights' Methods

Demo Applications: 

Demo Applications Room Controller Web pages generated from XML service descriptions Remote sessions Media control automation (video: 00:28-00:45) Mouse anywhere (video: 05:55-07:00)

Concluding Comments: 

Concluding Comments Ubiquitous computing needs middleware Addressing, message passing andamp; resource mgmt. Geometric knowledge essential for good UIs World model abstractions simplify application building Perception is (still!) hard