• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
23496302 project-oxygen  in word from scribd
 

23496302 project-oxygen in word from scribd

on

  • 565 views

 

Statistics

Views

Total Views
565
Views on SlideShare
565
Embed Views
0

Actions

Likes
1
Downloads
20
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft Word

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    23496302 project-oxygen  in word from scribd 23496302 project-oxygen in word from scribd Document Transcript

    • Seminar Report ’03 Project Oxygen THE APPROACHINTEGRATED TECHNOLOGIES THAT ADDRESSHUMAN NEEDS Oxygen enables pervasive, human-centered computing through acombination of specific user and system technologies. Oxygen’s user technologies directly address human needs. Speechand vision technologies enable us to communicate with Oxygen as ifwe’re interacting with another person, saving much time and effort.Automation, individualized knowledge access, and collaborationtechnologies help us perform a wide variety of tasks that we want to doin the ways we like to do them. Oxygen’s system technologies dramatically extend our range bydelivering user technologies to us at home, at work, or on the go.Computational devices, called Enviro21s (E21s), embedded in our homes,offices, and cars sense and affect our immediate environment. Hand-helddevices, called Handy21s (H21s), empower us to communicate andcompute no matter where we are. Dynamic networks (N21s) help ourmachines locate each other as well as the people, services, and resourceswe want to reach.Oxygen’s user technologies include: The Oxygen technologies work together and pay attention toseveral important themes:Dept. of CSE -1- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen• Distribution and mobility — for people, resources, and services.• Semantic content — what we mean, not just what we say.• Adaptation and change — essential features of an increasingly dynamic world.• Information personalities — the privacy, security, and form of our individual interactions with Oxygen. Oxygen is an integrated software system that will reside in thepublic domain. Its development is sponsored by DARPA and the OxygenAlliance industrial partners, who share its goal of pervasive, human-centered computing. Realizing that goal will require a great deal ofcreativity and innovation, which will come from researchers, students,and others who use Oxygen technologies for their daily work during thecourse of the project. The lessons they derive from this experience willenable Oxygen to better serve human needs.USER TECHNOLOGIESDept. of CSE -2- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen SYSTEM TECHNOLOGIESDEVICES AND NETWORKS People access Oxygen through stationary devices (E21s) embeddedin the environment or via portable hand-held devices (H21s). Theseuniversally accessible devices supply power for computation,communication, and perception in much the same way that wall outletsand batteries deliver power to electrical appliances. Although notcustomized to any particular user, they can adapt automatically or bemodified explicitly to address specific user preferences. Like poweroutlets and batteries, these devices differ mainly in how much energythey can supply.E21 STATIONARY DEVICES Embedded in offices, buildings, homes, and vehicles, E21s enableus to create situated entities, often linked to local sensors and actuators,that perform various functions on our behalf, even in our absence. Forexample, we can create entities and situate them to monitor and changethe temperature of a room, close a garage door, or redirect email tocolleagues, even when we are thousands of miles away. E21s providelarge amounts of embedded computation, as well as interfaces to cameraand microphone arrays, thereby enabling us to communicate naturally,using speech and gesture, in the spaces they define.Dept. of CSE -3- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen E21s provide sufficient computational power throughout theenvironment• To communicate with people using natural perceptual resources, such as speech and vision,• To support Oxygens user technologies wherever people may be, and• To monitor and control their environment. E21s, as well as H21s, are universal communication andcomputation appliances. E21s leverage the same hardware componentsas the H21s so that the same software can run on both devices. E21s differfrom H21s mainly in• Their connections to the physical world,• The computational power they provide, and• The policies adopted by the software that runs on the devices.CONNECTIONS TO THE PHYSICAL WORLD E21s connect directly to a greater number and wider variety ofsensors, actuators, and appliances than do H21s. These connectionsenable applications built with Oxygens perceptual and user technologiesto monitor and control the environment.Dept. of CSE -4- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen An E21 might control an array of microphones, which Oxygensperceptual resources use to improve communication with speakers byfiltering out background noise. Similarly, it might control an array ofantennas to permit improved communication with nearby H21s that, as aresult of a better signal-to-noise ratio, use less power. Multiple antennasmounted on the roof of a building, as well as incoming terrestrial lines,connect through E21s to high-bandwidth, local-area N21 networks. Through the N21 network, an E21 can connect unobtrusively toH21s in the hands or pockets of people in an intelligent space. It candisplay information on an H21 display in a persons hand or on a nearbywall-mounted display; it may even suggest that the person step a fewfeet down the hall.H21 HAND-HELD DEVICES Users can select hand-held devices, called H21s, appropriate to thetasks they wish to perform. These devices accept speech and visual input,Dept. of CSE -5- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygencan reconfigure themselves to perform a variety of useful functions, andsupport a range of communication protocols. Among other things, H21scan serve as cellular phones, beepers, radios, televisions, geographicalpositioning systems, cameras, or personal digital assistants, therebyreducing the number of special-purpose gadgets we must carry. Toconserve power, they may offload communication and computation ontonearby E21s. Handheld devices, called H21s, provide flexibility in a lightweightdesign. They are anonymous devices that do not carry a large amount ofpermanent local state. Instead, they configure themselves throughsoftware to be used in a wide range of environments for a wide variety ofpurposes. For example, when a user picks up an anonymous H21, theH21 will customize itself to the users preferred configuration. The H21scontain board-level antennas that enable them to couple with a wirelessN21 network, embedded E21 devices, or nearby H21s to formcollaborative regions.Dept. of CSE -6- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen H21s, like E21s, are universal communication and computationappliances. They leverage the same hardware components as the E21s sothat the same software can run on both devices. H21s differ from E21smainly in• Their connections to the physical world,• The computational power they provide, and• The policies adopted by the software that runs on the devices.CONNECTIONS TO THE PHYSICAL WORLD Because handheld devices must be small, lightweight, and powerefficient, H21s come equipped with only a few perceptual andcommunication transducers, plus a low-power network to extend the I/O devices to which it can connect. In particular, H21s are not equippedwith keyboards and large displays, although they may be connected tosuch devices. Through the N21 network, an H21 can connectunobtrusively to nearby, more powerful E21s, which provide additionalconnections to the physical world. The H21 contains multiple antennasfor multiple communications protocols that depend on the transmissionrange, for example, building-wide, campus wide, or point-to-point.NETWORK AND SOFTWARE INFRASTRUCTUREDept. of CSE -7- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen People use Oxygen to accomplish tasks that are part of their dailylives. Universally available network connectivity and computationalpower enable decentralized Oxygen components to perform these tasksby communicating and cooperating much as humans do inorganizations. Components can be delegated to find resources, to linkthem together in useful ways, to monitor their progress, and to respondto change.N21 NETWORKS N21s support dynamically changing configurations of self-identifying mobile and stationary devices. They allow us to identifydevices and services by how we intend to use them, not just by wherethey are located. They enable us to access the information and serviceswe need, securely and privately, so that we are comfortable integratingOxygen into our personal lives. N21s support multiple communicationprotocols for low-power local, building-wide, and campus-widecommunication, enabling us to form collaborative regions that arise,adapt, and collapse as needed.Dept. of CSE -8- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen Flexible, decentralized networks, called N21s, connect dynamicallychanging configurations of self-identifying mobile and stationarydevices. N21s integrate different wireless, terrestrial, and satellitenetworks into one seamless internet. Through algorithms, protocols, andmiddleware, they• Configure collaborative regions automatically, creating topologies and adapting them to mobility and change.• Provide automatic resource and location discovery, without manual configuration and administration.• Provide secure, authenticated, and private access to networked resources.• Adapt to changing network conditions, including congestion, wireless errors, latency variations, and heterogeneous traffic (e.g., audio, video, and data), by balancing bandwidth, latency, energy consumption, and application requirements.COLLABORATIVE REGIONS Collaborative regions are self-organizing collections of computersand/or devices that share some degree of trust. Computers and devicesmay belong to several regions at the same time. Membership is dynamic:mobile devices may enter and leave different regions as they moveDept. of CSE -9- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygenaround. Collaborative regions employ different protocols for intra-spaceand inter-space communication because of the need to maintain trust.RESOURCE AND LOCATION DISCOVERY N21 networks enable applications to use intentional names, not justlocation-based names, to describe the information and functionality theyare looking for. Intentional names support resource discovery byproviding access to entities that cannot be named statically, such as a fullsoda machine or to the surveillance cameras that have recently detectedsuspicious activity. N21 networks integrate name resolution and routing. Intra-spacerouting protocols perform resolution and forwarding based on queriesthat express the characteristics of the desired data or resources in acollaborative region. Late binding between names and addresses (i.e., atdelivery time) supports mobility and multicast. Early binding supportshigh bandwidth streams and anycast. Wide-area routing uses a scalableresolver architecture; techniques for soft state and caching providescalability and fault tolerance. N21 networks support location discovery through proximity tonamed physical objects (for example, low-power RF beacons embeddedin the walls of buildings). Location discovery enables mobile devices toaccess and present location-specific information. For example, an H21Dept. of CSE -10- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygenmight help visitors navigate to their destination with spoken right-leftinstructions; held up next to a paper or an electronic poster of an old talk,it could provide access to stored audio and video fragments of the talk;pointed to a door, it could provide information about what is happeningbehind the door.SECURITY A collaborative region is a set of devices that have been instructedby their owners to trust each other to a specified degree. A collaborativeregion that defines a meeting, for example, has a set of trust andauthorization rules that specify what happens during a meeting (howworking materials and presentation illustrations are shared, who canprint on the local printer). Typically, trust rules for a meeting do notallow participants to write arbitrary information anywhere in the region.However, once users know what the trust rules are, they can introducetheir devices into the meetings collaborative region, with confidence thatonly the expected range of actions will happen, even if the details of theinteractions are left to automatic configuration. Resource and location discovery systems address privacy issues bygiving resources and users control over how much to reveal. Rather thantracking the identity, location, and characteristics of all resources andusers at all times, these systems accept and propagate only theinformation that resources and users choose to advertise. Self-certifyingnames enable clients of discovery systems to trust the advertisedinformation.Dept. of CSE -11- MESCE Kuttippuram
    • Seminar Report ’03 Project OxygenADAPTATION N21 networks allow devices to use multiple communicationprotocols. Vertical handoffs among these protocols allow H21 devices toprovide seamless and power efficient connectivity across a wide range ofdomains, for example, building-wide, campus wide, and point-to-point.They also enable applications to adapt to changes in channel conditions(e.g., congestion and packet loss) and in their own requirements (e.g., forbandwidth, latency, or reliability). They provide interfaces to monitoringmechanisms, which allow end-host transport agents to learn aboutcongestion or about packet losses caused by wireless channel errors. Thisenables end-to-end resource management based on a unified congestionmanager, which provides different flows with "shared state learning" andallows applications to adapt to congestion in ways that accommodate theheterogeneous nature of streams. Unlike the standard TCP protocol,which is tuned for bulk data transfers, the congestion manager efficientlyhandles congestion due to audio, video, and other real-time streamingapplications, as well as to multiple short connections. N21 networksprovide interfaces to control mechanisms, which enable applications toinfluence the way their packets are routed.SOFTWARE ARCHITECTURE Oxygen’s software architecture supports change above the deviceand network levels. The software architecture matches current user goalswith currently available software services, configuring those services toDept. of CSE -12- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygenachieve the desired goals. When necessary, it adapts the resultingconfigurations to changes in goals, available services, or operatingconditions. Thereby, it relieves users of the burden of directing andmonitoring the operation of the system as it accomplishes their goals. USER TECHNOLOGIES Several important technologies harness Oxygen’s pervasivecomputational, communication, and perceptual resources to advance thehuman-centered goal of enabling people to accomplish more with lesseffort.SPOKEN LANGUAGE, SKETCHING AND VISUAL CUES Spoken language and visual cues, rather than keyboards and mice,define the main modes of interaction with Oxygen. By integrating thesetwo technologies, Oxygen can better discern our intentions, for example,by using vision to augment speech understanding through therecognition of facial expressions, gestures, lip movements, and gaze.These perceptual technologies are part of the core of Oxygen, not justafterthoughts or interfaces to separate applications. They can be customized quickly in Oxygen applications to makeselected human-machine interactions easy and natural. Gracefulswitching between different domains (e.g., from a conversation about theDept. of CSE -13- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygenweather in Rome to one about airline reservations) supports seamlessintegration of applications.Dept. of CSE -14- MESCE Kuttippuram
    • Seminar Report ’03 Project OxygenKNOWLEDGE ACCESS Individualized knowledge access technologies offer greatlyimproved access to information — customized to the needs of people,applications, and software systems. Universal access to information isfacilitated through annotations that allow content-based comparisonsand manipulations of data represented in different formats and usingdifferent terminologies. Users may access their own knowledge bases,those of friends and associates, and other information publicly availableon the Web. The individualized knowledge access subsystem supports thenatural ways people use to access information. In particular, it supportspersonalized, collaborative, and communal knowledge, "triangulating"among these three sources of information to find the information peopleneed. It observes and adapts to its users, so as to better meet their needs.The subsystem integrates the following components to gather and storedata, to monitor user access patterns, and to answer queries and interpretdata.DATA REPRESENTATION The subsystem stores information encountered by its users usingan extensible data model that links arbitrary objects via arbitrarily namedarcs. There are no restrictions on object types or names. Users and thesystem alike can aggregate useful information regardless of its form (text,speech, images, video). The arcs, which are also objects, representDept. of CSE -15- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygenrelational (database-type) information as well as associative (hypertext-like) linkage. For example, objects and arcs in As data model canrepresent Bs knowledge of interest to A—and vice versa.DATA ACQUISITIONThe subsystem gathers as much information as possible about theinformation of interest to a user. It does so through raw acquisition ofdata objects, by analyzing the acquired information, by observingpeoples use of it, by encouraging direct human input, and by tuningaccess to the user.AUTOMATIC ACCESS METHODS The arrival of new data triggers automated services, which, inturn, obtain further data or trigger other services. Automatic servicesfetch web pages, extract text from postscript documents, identify authorsand titles in a document, recognize pairs of similar documents, andcreate document summaries that can be displayed as a result of a query.The system allows users to script and add more services, as they areneeded.HUMAN ACCESS METHODS Since automated services can go only so far in carrying out thesetasks, the system allows users to provide higher quality annotations onthe information they are using, via text, speech, and other humaninteraction modalities.Dept. of CSE -16- MESCE Kuttippuram
    • Seminar Report ’03 Project OxygenAUTOMATED OBSERVERS Subsystems watch the queries that users make, the results theydwell upon, the files they edit, the mail they send and receive, thedocuments they read, and the information they save. The system exploitsobservations of query behavior by converting query results into objectsthat can be annotated further. New observers can be added to exploitadditional opportunities. In all cases, the observations are used to tunethe data representation according to usage patterns.AUTOMATION The automation subsystem provides technologies forencapsulating objects, both physical and virtual, so that their actions canbe automated. It also provides scripting technologies that automate newprocesses in response to direct commands, or by observing, imitating,and fine-tuning established processes.BASIC AUTOMATION OBJECTS Basic automation objects are "black boxes" of low-level actions thatcan be managed by higher-level automation processes. The objects can beeither physical or virtual. A basic physical object senses or actuates aphysical entity—it may sense the temperature or whether an office dooris open, and it may crank up the heat or send an image to a display. Abasic virtual object collects, generates, or transforms information—it mayDept. of CSE -17- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygenextract designated items from incoming electronic forms, operate onthem in a designated manner, and send the results to a particular device.A common intelligent interface connects basic physical objects to thenetwork. The interface consists of a chip containing a microprocessor, anetwork adapter, main memory, and non-volatile storage. It makesdifferent sensors, actuators, and appliances more powerful, providesdevice status information, reduces the bandwidth they require, anddownloads commands and new low-level software.Any software object can be a basic virtual object. Electronic forms areparticularly common basic virtual objects, because they serve asconvenient "interfaces" for exchanging information among people andorganizations.CONTROL OVER COMBINED OBJECTS The automation architecture provides mechanisms for composingmodular components, such speech, vision, and appliances, and forcontrolling their behavior based on user scripts. The architecture allowsdistributed objects (or agents) to refer to one another by function andcapability, without respect to their location. Objects communicate using auniversal streaming data "bus" standard. They can move around, be re-connected dynamically, and seamlessly resume previously establishedconnections with one another. The scripting language enables users tospecify easily and rapidly the tasks they wish to automate. The automation subsystem uses a top-level watch-reason-automate"loop" to monitor and filter information of interest to the automationprocess, to select appropriate automation regimes for given tasks, and toDept. of CSE -18- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygenimplement those regimes. The scripting language enables users tocustomize automation regimes in response to context changes and otherfactors too complicated to handle automatically, either in the originalscript or in the watch-reason-automate loop.COLLABORATION The collaboration subsystem uses the knowledge access subsystemand the automation subsystem to support collaboration. Thecollaboration subsystem adds to the "semantic web" of the knowledgeaccess subsystem by recording the context of human-to-humaninteractions. It informs the automation and knowledge access subsystemswhen we are engaged in a collaborative task so that the responses ofthese subsystems can be tailored appropriately to all those participatingin the task.MAINTAINING COLLABORATION CONTEXT The collaboration subsystem uses the individualized knowledgeaccess subsystem to represent and acquire information about humaninteractions, for example, by using the vision subsystem to determinewho is present at a discussion and to observe physical gestures, by usingthe spoken language subsystem to track what people say to each other,and by observing human interactions with software applications. Thecollaboration subsystem remembers how a group arranges its workspace,and it creates virtual work places for distributed groups. It maintains thecontext of each collaborative group in an individualized knowledgedatabase, so that it can be recalled to continue the discussion at a futureDept. of CSE -19- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygentime or in another place. Automated observers track features of interestto the collaboration and add to the knowledge database. Semantic linksin the database maintain the history of the discussion and identify issues,alternative courses of action, arguments for and against each alternative,and resolutions to pursue particular alternatives. Human input helpsguide the indexing process, by identifying critical decisions and linkingthem to the rationale behind them.AUTOMATING COLLABORATIVE TASKS The collaboration subsystem uses the automation subsystem,together with Bayesian techniques for analysis and knowledge-basedtechniques for process management, to act as a coordinator and mediateinteractions among members of a collaborative team. It knows theinterests, organizational roles, and skills of all team members, and itunderstands the application domain within which the team functions.For example, it tracks action items within the group and dependencieswith other groups, retrieving relevant information and bringing it to theattention of the most appropriate individuals. The collaboration systemplays the role of an active participant, noticing tasks that need to beundertaken, noticing when information required for those tasks has beendeveloped, and making conclusions when appropriate.Dept. of CSE -20- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen SOFTWARE TECHNOLOGIESProject Oxygens software architecture provides mechanisms for• Building applications using composable, distributed components,• Customizing, adapting, and altering component behavior,• Replacing components, at different degrees of granularity, in a consistent fashion,• Person-centric, rather than device-centric, security, and• Disconnected operation and nomadic code. Oxygens software architecture relies heavily on abstraction tosupport change through adaptation and customization, on specification tosupport components that use these abstractions, and on persistent objectstores with transactional semantics to provide operational support forchange.ABSTRACTION Computations are modular, as is storage. Abstractions characterizecomponents that carry out computations and objects used incomputations. In Oxygen, abstractions support the use of adaptablecomponents and objects by providing• Application access to components traditionally hidden beneath intervening layers of software, so as to observe and influence their behavior.• Intent-based interfaces, not just syntax or address-based interfaces, so as to facilitate component and object use, adjustment, replacement, and upgrade.Dept. of CSE -21- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen• Stream-oriented interfaces that treat speech, vision, and sensor data as first-class objects, so as to enable compilers to manage low-level pipelining concurrency and multithreaded programs to adjust their behavior correctly at runtime in response to changes in the number of streams or the interactions among them.• Constraint and event abstractions, which separate computation from control, trigger what is processed when, and provide flexibility for modifying behavior at runtime without compromising system integrity.• Cutpoints, so as to provide safe fallbacks and to enable "eternal computation".SPECIFICATIONS Specifications make abstractions explicit, exposing features to othersystem components. In Oxygen, specifications support adaptation andchange by providing information about• system configurations, to determine what modules and capabilities are available locally,• module repositories, to provide code over the network for installation on handheld and other devices,• module dependencies, to support complete and consistent installations or upgrades,• module capabilities, to support other components and applications in scripting their use, and• module behavior, to support their safe use through a combination of static and runtime checks.Dept. of CSE -22- MESCE Kuttippuram
    • Seminar Report ’03 Project OxygenPERSISTENT OBJECT STORE WITH TRANSACTIONALSEMANTICS Code, data objects, and specifications reside in a common object-oriented store, which supports all Oxygen technologies (i.e., user,perceptual, system, and device technologies). Object-orientation helpsmaintain the integrity of the store by restricting updates to thoseperformed by methods in the store. The store has transactional semantics,which enables concurrent access, rollback and recovery, and consistentupdates to modules and data. It also operates efficiently, usingtechniques such as optimistic concurrency, pre-fetching, and lazyupdates and garbage collection, which defer the costs of modifying thestore as long as possible or until there is time to spare.Dept. of CSE -23- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen HOW DOES OXYGEN WORKDept. of CSE -24- MESCE Kuttippuram
    • Seminar Report ’03 Project OxygenThe figure showing h21-n21-e21 communications.Dept. of CSE -25- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen PERCEPTUAL TECHNOLOGIESSPEECH The spoken language subsystem provides a number of limited-domain interfaces, as well as mechanisms for users to navigateeffortlessly from one domain to another. Thus, for example, a user caninquire about flights and hotel information when planning a trip, thenswitch seamlessly to obtaining weather and tourist information. Thespoken language subsystem stitches together a set of useful domains,thereby providing a virtual, broad-domain quilt that satisfies the needs ofmany users most of the time. Although the system can interact with usersin real-time, users can also delegate tasks for the system to performoffline. The spoken language subsystem is an integral part of Oxygensinfrastructure, not just a set of applications or external interfaces. Fourcomponents, with well-defined interfaces, interact with each other andwith Oxygens device, network, and knowledge access technologies toprovide real-time conversational capabilities.Dept. of CSE -26- MESCE Kuttippuram
    • Seminar Report ’03 Project OxygenSPEECH RECOGNITION The speech recognition component converts the users speech intoa sentence of distinct words, by matching acoustic signals against alibrary of phonemes—irreducible units of sound that make up a word.The component delivers a ranked list of candidate sentences, either to thelanguage-understanding component or directly to an application. Thiscomponent uses acoustic processing (e.g., embedded microphone arrays),visual clues, and application-supplied vocabularies to improve itsperformance.LANGUAGE UNDERSTANDING The language understanding-component breaks down recognizedsequences of words grammatically, and it systematically represents theirmeaning. The component is easy to customize, thereby easing integrationinto applications. It generates limited-domain vocabularies andgrammars from application-supplied examples, and it uses thesevocabularies and grammars to transform spoken input into a stream ofcommands for delivery to the application. It also improves languageunderstanding by listening throughout a conversation—not just toexplicit commands—and remembering what has been said. Lite speech systems, with user-defined vocabularies and actions,can be tailored quickly to specific applications and integrated with otherparts of the Oxygen system in a modular fashion.Dept. of CSE -27- MESCE Kuttippuram
    • Seminar Report ’03 Project OxygenLANGUAGE GENERATIONThe language generation component builds sentences that presentapplication-generated data in the users preferred language.SPEECH SYNTHESIS A commercial speech synthesizer converts sentences, obtainedeither from the language generation component or directly from theapplication, into speech.VISION The visual processing system contains visual perception and visualrendering subsystems. The visual perception subsystem recognizes andclassifies objects and actions in still and video images. It augments thespoken language subsystem, for example, by tracking direction of gaze ofparticipants to determine what or whom they are looking at during aconversation, thereby improving the overall quality of user interaction.The visual rendering subsystem enables scenes and actions to bereconstructed in three dimensions from a small number of sample imageswithout an intermediate 3D model. It can be used to provide macroscopicviews of application-supplied data. Like the spoken language subsystem, the visual subsystem is anintegral part of Oxygens infrastructure. Its components have well-defined interfaces, which enable them to interact with each other andwith Oxygens device, network, and knowledge access technologies. LikeDept. of CSE -28- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygenlite speech systems, lite vision systems provide user-defined visualrecognition, for example, of faces and handwritings.OBJECT RECOGNITION A trainable object recognition component automatically learns todetect limited-domain objects (e.g., people or different kinds of vehicles)in unconstrained scenes using a supervised learning technology. Thislearning technology generates domain models from as little informationas one or two sample images, either supplied by applications or acquiredwithout calibration during operation. The component recognizes objectseven if they are new to the system or move freely in an arbitrary settingagainst an arbitrary background. As people do, it adapts to objects, theirphysical characteristics, and their actions, thereby learning to improveobject-specific performance over time. For high-security transactions, where face recognition is not areliable solution, a vision-based biometrics approach (e.g., fingerprintrecognition) integrates sensors in handheld devices transparently withthe Oxygen privacy and security environment to obtain cryptographickeys directly from biometrics measurements.ACTIVITY MONITORING AND CLASSIFICATION An unobtrusive, embedded vision component observes and tracksmoving objects in its field of view. It calibrates itself automatically, usingtracking data obtained from an array of cameras, to learn relationshipsamong nearby sensors, create rough site models, categorize activities in avariety of ways, and recognize unusual events.Dept. of CSE -29- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen CHALLENGES To support highly dynamic and varied human activities, theOxygen system must master many technical challenges. It must be pervasive—it must be everywhere, with every portal reaching into the same information base; embedded—it must live in our world, sensing and affecting it; nomadic—it must allow users and computations to move around freely, according to their needs; adaptable—it must provide flexibility and spontaneity, in response to changes in user requirements and operating conditions; powerful, yet efficient—it must free itself from constraints imposed by bounded hardware resources, addressing instead system constraints imposed by user demands and available power or communication bandwidth; intentional—it must enable people to name services and software objects by intent, for example, "the nearest printer," as opposed to by address; eternal—it must never shut down or reboot; components may come and go in response to demand, errors, and upgrades, but Oxygen as a whole must be available all the time.Dept. of CSE -30- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen CONCLUSION Widespread use of Oxygen and its advanced technologies willyield a profound leap in human productivity — one even morerevolutionary than the move from mainframes to desktops. By enablingpeople to use spoken and visual cues to automate routine tasks, accessknowledge, and collaborate with others anywhere, anytime, Oxygenstands to significantly amplify human capabilities throughout the world.Dept. of CSE -31- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen REFERENCES 1. WWW.LCS.MIT.EDU 2. WWW.AI.MIT.EDU 3. WWW.GLOBAL.ACER.COM 4. WWW.DELTACA.COM 5. WWW.HP.COM 6. WWW.NTT.CO.JP 7. WWW.NOKIA.COM 8. WWW.RESEARCH.PHILIPS.COM 9. IEEE Spectrum March 2002Dept. of CSE -32- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen ABSTRACT In the future, computation will be human-centered. It will be freelyavailable everywhere, like batteries and power sockets, or oxygen in theair we breathe. It will enter the human world, handling our goals andneeds and helping us to do more while doing less. We will not need tocarry our own devices around with us. Instead, configurable genericdevices, either handheld or embedded in the environment, will bringcomputation to us, whenever we need it and wherever we might be. Aswe interact with these "anonymous" devices, they will adopt ourinformation personalities. They will respect our desires for privacy andsecurity. New systems will boost our productivity. They will help usautomate repetitive human tasks, control a wealth of physical devices inthe environment, find the information we need (when we need it,without forcing our eyes to examine thousands of search-engine hits),and enable us to work together with other people through space andtime. It must be accessible anywhere. It must adapt to change, both inuser requirements and in operating conditions. It must never shut downor reboot —components may come and go in response to demand, errors,and upgrades, but Oxygen as a whole must be available all the time.Dept. of CSE -33- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen CONTENTS 1. THE APPROACH 1 2. SYSTEM TECHNOLOGIES 3 3. USER TECHNOLOGIES 13 4. SOFTWARE TECHNOLOGIES 20 5. HOW DOES OXYGEN WORK? 23 6. PERCEPTUAL TECHNOLOGIES 25 7. CHALLENGES 29 8. CONCLUSION 30 9. REFERENCES 31Dept. of CSE -34- MESCE Kuttippuram
    • Seminar Report ’03 Project Oxygen ACKNOWLEDGEMENTS I express my sincere thanks to Prof. M.N AgnisarmanNamboothiri (Head of the Department, Computer Science andEngineering, MESCE), Mr. Zainul Abid (Staff incharge) for their kind co-operation for presenting the seminar. I also extend my sincere thanks to all other members of the facultyof Computer Science and Engineering Department and my friends fortheir co-operation and encouragement. P.M. NibilDept. of CSE -35- MESCE Kuttippuram