The Artificial Technology Center AiDigital Library ™
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Author: Daniel Delgado Aug. 31, 1999 Revised: Gordon H Kraft July 5, 2000 Oct. 9, 2001 (c) COPYRIGHT 1999 - 2001 Artiﬁcial, Inc.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
SECTION I: The Artiﬁcial Technology Center™ with an AiHome™What is the Artiﬁcial Technology Center?The Artiﬁcial Technology Center (ATC) is to be a new and unique research anddevelopment laboratory. Its purpose is to advance and promote the technology ofhigh-speed (Broadband) Internet applications. The center will advance thetechnology with an innovative research and development series of projects. It willpromote the technology by demonstrating and educating the public as to the newpossibilities offered by a broadband Internet (Bi). The ATC will use a constantﬂow of the latest PC and Audio/Video equipment and systems. The ATC will bebuilt inside of a normal Executive Ofﬁce Building with the construction of a partialhouse (approximately 1200sqft.) with easy to visualize Smart House wiring andthe ability to use the ATC house called a AiHome™ as a retail store, a livedevelopment lab, and a classroom.Why is it needed?Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
The Center is needed for one primary reason - to develop proﬁtable systems forthe Internet of tomorrow. All businessmen are aware of the difﬁculties indeveloping new products. Developing products for the Internet is even morechallenging because no one knows how the Internet will grow and what it willgrow into. We do know that its amazing technological advances have changedthe rules of commerce, yet we do not yet know what those rules have changedinto. Because of this, developing creative and proﬁtable products is much moredifﬁcult on the Internet than in the past.The Center will be an environment designed to quickly produce new productsand technologies. It takes advantage of the fact that advances in broadbandtechnology will soon turn the Internet into a high bandwidth network to the home.These changes will open the door for a host of previously impossibleapplications. The Center solves the problem of how to create these differentapplications and it also determines if they will be proﬁtable. It does this bybuilding an environment where an Internet user can use the new applications in ameaningful and productive way, and where at the same time, we can assess theirusefulness and proﬁtability. The ATC’s environment is available online via the Biand is called the AiDigital Library™.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Gateway ComputersProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
SECTION II: The AiDigital Library™What is the AiDigital Library?The AiDigital Library is conceived as integration, both physically and in theabstract, of a library with the World Wide Web as it’s bookshelf. The goal is havean environment consisting of library and web, which fulﬁlls the functions of bothin the most useful and human centered manner possible.We are building a library because a library, seen as a physical container ofknowledge, has the same function as the Internet - today’s most successful andpowerful container of Knowledge. The Internet has its enormity and timeliness ofinformation, hyperlinks, plus the well-honed excellence of the various searchengines The library, on the other hand, has the advantage of human comfortsuch as windows, chairs, desks, and space. Both however have the samefunction, which is to serve us humans in our ability to acquire, manipulate, andcreate information.As the Center’s main tool for product development, the AiDigital Library will servemultiple roles as think tank, R&D facility, and technology showcase. By building itwe hope not only to demonstrate the advanced capabilities offered by a highbandwidth Internet, but also to act as a bootstrap and catalytic agent for thedevelopment of commercially successful products.The AiDigital Library will require innovative hardware and software I/O devicesand solutions. The library must make one’s physical environment a powerful toolfor accessing and manipulating the multitude of information streams present onthe Internet: such as HDTV video, surround sound, hypertext search engines,and 3D visual data sets. Conversely, it must also allow one to control the physicalProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
aspects of the library in such a way as to facilitate one’s control of the Internetand it’s multimedia. Solving these problems, and in general building the library,will result in the proﬁtable Internet application’s needed for commercial success.SECTION III: The Components OverviewThe Artiﬁcial, Inc. “AiDigital Library” is a ongoing research and developmentproject aimed at providing the user a multimedia digital library of all of theirdocuments, photos, and home/corporate videos, as well as the using the internetas our Global Infobase. How it’s doneThe computer selected is a SONY VAIO computer system with a Pentium IV,DVD, DV Firewire interface, Macintosh G4 DVDr system, VideoConferenceCamera, Color printer, Sony LCD ﬂat panel screen, and a Digital Camera. Thehuman interface is a local web site using our AI 3D-library QTVR look and feel;the user can operate everything in the room. From the rack of the Home Theaterequipment in the AI 3D library, the user can access the any of the equipmentusing a connection to the AV control system, as well as cruise the internet, orretrieve and show documents, movies, and images. The Control PC isProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
connected to the home Cat 5 network or wireless network and to the Internet viaa Broadband T1/DSL or faster. The performance of the resulting AiHome musthave the ability to transmit and receive full motion video in a minimum of MPEG4format to a maximum of HDTV format.The use of various high capacity storage or Mass Storage Devices will berequired to store and retrieve the massive amounts of digital information.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
AiLibrary, Inc. • A Sony Clie PDA is used as the Remote Control for the AiLibrary.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
AiLibrary, Inc. • A Sony Clie PDA is used as the Remote Control for the AiLibrary. • You click via finger or stylus the visual item area of interest.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Sony AiDigital Library™Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
PowerFile™Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
PowerFile™ Mass Storage Facility capable of 1 Terabyte per unit (can bedaisychained) connected via Firewire™.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Macintosh AiDigital Library™ From imagination to realityProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Digital Library Hardware/Software Conﬁguration DiagramsThese diagrams show the information ﬂow through the hardware and software ofthe Digital Library. A software box is always inside a hardware box, so, forexample, the Library Server is a large gray box containing the boxes naming theserver software, the AIQuery Engine, the Crestron web software, and the webbrowser.An arrow means a physical connection with the direction being eitherunidirectional such as with the audio/video signal going to the Wide ScreenMonitor (red), or bi-directional such as with the Library Personal ComputerEthernet connection to the server (green).One thing to notice is that in both diagrams the software AIServer box extendsacross the hardware box. This is done to signify that the server is indeed theserver, such that all interactions between the Internet and any software thatneeds input or output must pass through it.In addition, both the Portable Digital Library and the Digital Library are shownwith independent hardware for the speech recognition. The portable one uses aninterface card (which is why its box is inside the server box), while the DigitalLibrary uses an external serial device (blue). This is done in order to reducecomputational load on the server computer. Speech recognition is a real-timeprocess so if the load is too great then recognition performance gets too poor.However we may ﬁnd a software-only package that avoids this. Using an externaldevice also simpliﬁes programming since the Digital Server then receives itsspeech as a serial ASCII stream.The ST-COM, ST-I/O, ST-VC hardware boxes are modules need to do serialcommunication, bit I/O, and device control (e.g. receiver volume) respectively.The Digital Library book is a display device with a touch screen used tomanipulate web pages, and must be very simple and light. It does not by itselfhave any user input apart from that used in the touch screen. The main usercontrol will be the touch screen with the display mirroring the server browser, andalso the AI AudioResponse System (AiARS).The position sensors used on both libraries are for are for virtual windowing.One cannot use the Reality Fusion camera method for this because it would beProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
too slow. Several infrared (non-invasive) systems are available. Another beneﬁtis that if for some reason the Reality Fusion method is not workable then we canalso use it to obtain the users position.What will the library consist of?The AiDigital Library will have a variety of software and hardware components.They are named the following: The Physical Library The Library Web Site The Library Query Engine The Library Server Advanced Concept ToolsThe Physical LibraryThe Physical Library is an actual library. The present one is located in Florida.The library is comfortable, well lit, spacious, with computer access and a privatecollection of books, records, tapes etc. It also contains media players such as amultimedia capable computer, a HDTV capable large screen monitor, and astereo system. Regardless as to how we construct the AiDigital Library, we willmake sure it remains comfortable, spacious and well lit.The AiDigital Library is not meant to be a replacement for a traditional library, norfor the creation of a ‘super’ high tech system with lots of bells and whistles.These may be laudable goals but they miss the point of the AiDigital Library. Thegoal is to produce a melding of a library with its Internet counterpart. To do sosuccessfully, we must maintain those qualities of a traditional library that makes itenjoyable and easy to use. These include in no small part those that make itcomfortable, spacious, and well lit.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
The Library Web SiteAs with the Physical Library, the Library Web Site (version alpha) is active (http://www.ghklibrary.com/aidl). The Web Site will serve as the main conduit for theinteractions between the user, the Internet, and the Physical Library. Its mostimportant page is a well-done QuickTime VR rendition of the Physical Library.This page will have controls and gateways to other control pages, which willallow the manipulation of the AiDigital Library. For example, if one double clickson the image of the stereo system, then a new page comes up with informationabout the stereo system as well as controls to manipulate it. Likewise, if onedouble clicks on the image of the Wide Screen TV, information about your videodatabase and controls become available.Using a web site to control the library give certain advantages. We envision theAiDigital Library as containing a variety of different displays placed at variouslocations in it. Using the web in this fashion allows the user to control any numberof library Internet devices with the same interface and on the different displays.As such, the web site becomes a universal controller for the user.The current Physical Library uses software from Crestron Home Control Systems(http://www.crestron.com/website/index.html) for controlling the home. Thissoftware will also be used for the control of the library from the web site. Its usewill save us development time and assure compatibility with the house. Mostimportantly, the system is ideal for web hardware interfacing since it has beenspeciﬁcally designed for Internet control. In addition, it is a Java based system,which makes programming for the library much easier.The Library Web Site user interface, although doable in Java, will require the useof Shockwave and Director. Shockwave was used for the construction of thecurrent web site’s interface, and continuing do so allows for the use of previouswork. Furthermore, Shockwave works with QuickTime VR graphics. Currently,QuickTime VR type graphics are an important part of the web site since the maincontrol page is a QuickTime VR graphic. Many similar pages will be needed forthe future development. Fortunately both Apple and Macromedia (http://www.macromedia.com/shockwave/) have publicly available SoftwareDevelopment Kits (SDK). Apple released theirs years ago and Macromedia hasjust released theirs.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
The Library Query EngineIn a regular library a user is able to arrange his books, music etc. in whateverarrangement he desires (provided that it’s not the public library!). In addition, hecan and probably will continuously add new material to his library. He could storethese in any fashion he desires, perhaps even randomly. What he most likely willdo is to arrange them in categories and store them in various locations such asshelves to help him ﬁnd them in the future. Essentially, he wants space to storehis materials and a method to ﬁnd them whenever he wants to.The Library Query Engine is the AiDigital Library’s method for selecting andstoring Internet information that the user wants to select and store. In effect, itallows a user to do the same as he would in a regular library, however with all thetypes of information on the Internet.As one can imagine, developing a query engine is not trivial because of thediversity of the media on the Internet and the complexity of categorizing theinformation.A good example is the situation with photo and movie formats. There are manydifferent forms of media and variations of them, such as the picture formats JPGGIF, TIFF, and the various movies formats MOV, AVI, MPG etc. A query enginemust be sophisticated enough to decode all these formats and also learn aboutany new ones.A much more difﬁcult problem is how the query engine should categorizeinformation in a manner pertinent to the user. Consider the example of a GIFimage of a painting. One could categorize it by the colors, history, and evenmeaning. One analysis provides seven ways of making a suitable search engine(http://www.gils.net/showcase/). Some methods are very sophisticated andrequire the use of intelligent agents and/or content analysis.Fortunately, there has been a large amount of government and industrialcooperation in the making of a universally accepted search engine (e.g., http://www.dlib.org/projects.html). The result has been a concerted international effortto develop a world standard for searching for information. The standard is knownas ISO 10163 in all places except the US, where it is more commonly know asANSI Z39.50 does. This standard handles text information and also largecomplex collections such as found in libraries, universities, and museums (http://www.gils.net/webz3950.html).The US government has established the Global Information Locator Service(GILS) to assist in the development and dissemination of Z39.50 to the WorldWide Web (http://www.gils.net/webz3950.html). The result has been the easytransfer of the standard to the commercial sector. Among other efforts, GILSmakes available code samples and programming utilities for companies toimplement search engines using Z39.50. One such company, Blue AngelTechnology uses GILS to provide a large amount of the functionality required byProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
our engine (http://www.blueangeltech.com/). The AiDigital Library ‘s query enginecould be made in conjunction with this or other such developers so as to savetime and not duplicate efforts.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
The Library ServerIn a regular library, the user has shelves in which to store his information. TheLibrary Server will allow the user to do the same. However not just with textinformation as found in books, but with all different sorts of media. The LibraryServer will work in conjunction with the Query Engine to store multimedia andother information in the library. Furthermore, just as in a regular library where onenever has enough shelves, the Library Server should have the most possibleamount of disk space possible to hold all the information the user will store.The Library Server must, just like the Query Engine, categorize and selectinformation in an intelligent fashion. Think of what would happen otherwise. All ofus who surf the web invariably save some information. Consequently, all of uswho surf the web will most likely run out of disk space. What prevents this fromoccurring all the time is that we save only those bits of information meaningful tous? The Library Server needs to do the same thing.In addition to selecting what to save, the Library Server must deal with the formatin which to save it in. The PDF format from Adobe appears to be the best to usebecause PDF will be the most common interface output for the display panels.We might have used Z39.50 since it makes use of a common internal dataformat. However on the World Wide Web, the .PDF format is increasinglyProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
becoming the most favored method of storing documents that need to beaccessed from a web site. In addition, there are a large number of skilledprogrammers available with expertise in the .PDF format.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
SECTION IV: AdvancedConcept ToolsAdvanced concept tools are possible candidates for commercialization: Each toolwill be carefully examined as to its potential and feasibility. If acceptable, theconcept will then be turned into a working prototype for use in the AiDigitalLibrary. The library will be shown to the public and their reaction to the tool will beassessed. Based on this feedback and other more rigorous assessments (suchProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
as is done in usability testing and human factors), the tool will either be rejected,or added permanently to the AiDigital Library and developed for the marketplace.Building a tool is the most central part of the Library because it directly addressesthe issue of proﬁts. Building a tool uses all aspects of the Library. When ideas areproposed and critiqued, the library functions as a think tank. When a tool is built,the library functions as a rapid prototype and development lab. Finally, when thetool is demonstrated in the AiDigital Library, it acts as a marketing agency and ausability-testing laboratory.A potential tool must be assessed very carefully and meet certain criteria to besuccessful. As previously mentioned, the AiDigital Library can be thought of asthe integration of the Internet to one’s personal environment. It has as least twofunctions. First, it allows you to use one’s physical actions to work with theInternet. Secondly, it allows you to use the Internet to control one’s physicalenvironment. The library should be comprised of tools that accomplish thesefunctions. This is a loose criteria, but essential for maintaining the focus on theAiDigital Library.Currently, most Internet users explore the Web with a browser on a PC. With theAiDigital Library, we want this capability and much more. The reason we wantmuch more is because now, instead of accessing the Internet via one PC, wehave an entire room that we can transform into tools for interacting with theInternet. Some of these tools will use the room features as control devices formanipulating the Internet. Others will serve to use the room as a large-scaleaddition to the web browser.The following is a list with descriptions of tools that have been proposed as of9/19/99:Tool: The Internet Book.Description: A ﬂat LCD panel display that allows control of the AiDigital LibraryHome Page anywhere in the Library. The device would be very ﬂat, lightweightand rugged (encased in a cushion or leather padding). At the top left and righthand corners there would be large arrow buttons. These are used with theForward Backward icons in the web browser.The user goes to where he wants to in the library. Picks up the book and rightaway what he sees is the AiDigital Library page. As he manipulates the web siteicons, appropriate responses occur in the various items in the real library. Theinterface is the web browser so that there is a little learning curve for the user.Technically this is easy to implement. The quickest would be to use an industrialLCD panel with a long cable for connection to the network. If a cable is unwieldywe might want to go with a PC portable with an IR link to the net. Of course theIR link speed would not allow for the display to be used for video media, howeverthat would not be its main use. The user would turn his head up and view theProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
movie on the wide screen monitor. The book would be mostly as a room/Internetcontroller and use only the local pages.Tool: Visible Mouse FocusDescription: Mouse Focus refers to the object that is currently selected by amouse. In the real world we can also think about having a mouse focus thatmimics the position of the mouse in the web site. This can be implemented inseveral ways. One is that as the user moves the cursor to a hot spot (e.g. thestereo), a spotlight focused on the real object lights up. Another possibility is by aservo-controlled light. This light would change its position as the mouse moveson the screen. This may be nicer because the moving light is a closer simile to amoving mouse than a spotlight turning on. There is also another function that thistool serves. We can also use it to let the browser select a book from your library.If the browser knew your books and their location, it could point to a particularvolume when the browser search engine hits include information found in yourlibrary books.Tool: Reality FusionDescription: Without a doubt this can be a tremendous enhancement to thelibrary. Using any common computer video camera, it allows you to use thesubject’s position and posture to control things in the library. The company has aweb site with a demo version that one can download.http://www.realityfusion.comIt is very low cost, has a SDK, and being a local company, can perhaps be avaluable resource. Reality Fusion allows a tool called “User Focus”.Tool: User FocusDescription: This is an extension on the Visible Mouse Focus concept. We canthink of the user as having a ‘mouse focus’ that we want the Internet browser tobe aware of. For example, suppose that the user is choosing and adjusting hismusic system. Most likely, he will be standing next to the audio system so as toadjust the controls. The position next to the music system is a hot site just as theWeb version location is a hot zone for double clicking. Knowing the hot zone canbe very useful for modifying the equipment in preparation for its use. This iswhere Reality Fusion’s product is so helpful. We can use it to easily identifywhere the user is.Tool: Voice RecognitionDescription: This is an obvious one and must be included. This tool is anexample of a class of tools characterized by the fact that they are not marketable,yet still are needed for the Library. It is also a very important one because a poorimplementation would be worse then none at all. People get enormouslyProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
frustrated at voice recognition systems that do not work. A careful choice of themany available must be made to avoid public dissatisfaction with the AiDigitalLibrary as a wholeTool: Web Integrated Video Editor for Wide Screen TVDescription: The wide screen TV offers lots of possibilities that will be looked at inanother paper. Here, The tool gives is a non-linear editing capability for movies. Itdoesn’t have to be a complete set of controls, just sufﬁcient to allow a user tostop, review, clip and save. A user could make small pieces of multimedia thatserve as notes, study guides’ etc. For example, suppose the viewer just saw anews report about something pertinent to his job. The user should be able tofreeze the video, select segments, and create a small video clip. The browser willserve to let the user manipulate the clips. For example, when the user wants toselect clips to review, he selects their icons and drags them onto the Screen iconTool: Virtual HeadphonesDescription: As the user moves about, the library notes his location and movesthe audio “sweet spot” so that it follows the user. We can use Reality Fusiontechnology to obtain the user’s position. The movement of the sweet spot ispossible with PC sound cards that have 3D imaging capability, such as theSoundBlaster and Gravis cards.Tool: Video ConferencingDescription: Again an obvious one, not marketable, yet needed. To savedevelopment time, we will use an upper-end turnkey system offered to largecorporations. The magazine AV Video has reviews of these. For public relations,we might want to get a well-known appropriate celebrity and have him be at theother end of the conversation during important demonstrationsTool: Keyed informationDescription: Keeping in mind the library metaphor, which connotes an ability todo research, we should offer some method of keying various parts of themultimedia stream. For example during video playback, the user should be ableto mark the sequence (as previously described), but he should also be able toattach a text string used as a key for accessing information. The most naturalway of doing this would use voice recognition. Envision a user looking at a newsclip. He sees something of interest. Speaks “Stop”, “Rewind”, “Play for 10seconds”, “Save Segment as Conference Example”. Resulting in a video clipsaved to the server.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
SECTION V: The Portable AiDigital LibraryThe Portable AiDigital Library is an Advanced Concept Tool. It was not mentionedin the previous section because it merits a detailed description by itself. It will bethe ﬁrst tool to be built and the most complex to date.The Portable AiDigital Library will be designed so as to allow a person to have asmuch functionality of the real AiDigital Library as possible. This tool is needed fora variety of reasons. In order to market successfully any product arising from theAiDigital Library, we have to take it to potential customers and tradeshows. ThePortable AiDigital Library is designed for this purpose. In addition, because it issubstantially different than the AiDigital Library (because of its size), it will mostlikely result in additional product concepts than the original.The Portable AiDigital Library will have three separate LCD panels (not countingthe PC display). Each one will be thin, lightweight and mounted on a swivelingarmature, similar to that found in some light-stands. The display panels aremounted so that one can easily pick one up and reposition it by hand.The displays have several features. They have touch screens. They have theDimension-X overlay (http://www.dti3d.com) that allows 3D imaging. They havesensors that give the position of the screen with respect to the user.The display panels form the basics of visualization dome’ that can be rearrangeddepending of the type of multimedia to be presented. Here is how we can usethem:Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Functions of the Portable AiDigital Library -Panoramic images and movies:The user can put them side to side to form one large display. This can be used toshow movies and images in the wide screen format.Movie editing:One can place a movie clip on each display and use the third as a touch screencontrol for the editor. The editor could be a video-editing page on the library website.QuickTime VR viewing and control:If the user arranges them in a half-circle facing him, he would have an excellentviewer for QuickTime VR images. The displays arranged like this could give up toabout a 120-degree wraparound screen. Viewing a QuickTime VR image, e.g. ofthe AiDigital Library web site would be impressive. The touch screens wouldallow the user to sweep his hand across the display and literally pull the graphicsto where he wants.GIS analysis:If you place a screen looking up and below you, it can act as 3D-terrain viewerfor Geographic Information Systems (GIS). Its application could be inpetrochemical 3D mapping and satellite analysis.Flight, 3D, and game simulations:If you place the displays in a front, left, and right formation, they can be used forcar and ﬂight simulators. Used with a standard VRML plug-in, a browser (Cosmois the typical one) can act as ‘spaceship’ that one can use to ﬂy through theVRML space. This is done using the Dimension-X screen coating and theposition sensors on the displays. The Dimension-X allows stereoscopic 3Ddisplays without the encumbrance of glasses, and the position sensors allowvirtual windowing.Book and sheet music viewer:One could place 3 pages of a sheet of music or consecutive pages from a book.As a sheet music viewer, we can use Reality Fusion technology so that the usercan turn the page using physical motions.Videoconferencing:If we add a video camera to each display, we would have a videophone capableof a conference with multiple views of the participants (maybe useful) or ofanything that they put in front of the cameras (very useful).Distance Learning:Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Capturing live videos of lectures to a server will allow students in remoteclassrooms, distant cities and other far parts of the world the ability to attendclasses at secondary schools, colleges and universities at their convenience.The server allows not only distance learning but also time learning, in the sensethat they can view the lessons at a time of their choosing. This allows companyemployees working on undergraduate or graduate degrees, which must travel oncompany business or have to work during critical times, the ability to learn theirlessons even while accomplishing their regular company business. Anothermarket is in corporate training, military training or any other application whereimportant information needs to be retrieved when the viewer has available time.Tool: 3D-scanner station:If we add a video camera to each display, you could use it to produce real-timeavatars of any object placed in front of the displays. Several companies makesoftware that takes multiple view of an object, such as with pictures, andrecreates it as a 3D volumetric model. What has not been produced is a real-time3D volumetric model! This is not necessarily due to it being technicallyunfeasible, but rather because without some sort of multiple camera arraignment,there is no use for such software. The Portable AiDigital Library will have multiplecameras and so can make use of such software. One company makes a productthat wraps a picture of a person in a smart manner so that it looks realistic.However, it does this on a generic head model. A combination of this technologycombined with real-time 3D volumetric rendering has great potential, and at theleast would be impressive.Networking:There is no reason apart from cost not to have the displays be addressable fromthe Internet. This would allow the useful feature of automatic conﬁguration. Auser could just put one of these things close to another, and they would senseeach others presence and conﬁgure the visual displays accordingly.Section VI: Potential Business AssociatesThis project will require a variety of technologies, and thus will also requiredbusiness relationships with the companies that make those technologies. This isviewed as another beneﬁt derived from the building of the AiDigital Library. Herewe identify those businesses.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
BroadBand Networks Corporationhttp://www.bbnc.comBroadBand Networks Corporation or BBNC is a company specializing in a varietyof hardware for making broadband transmission possible, primarily for the cableindustry. BBNC is a prime example of the company that the Center was designedto help. As such, we provide new product concepts and marketing by using theirdevices in the AiDigital Library.Macromediahttp://www.macromedia.com/shockwave/Macromedia makes Shockwave, which allows multimedia like effects with on theweb. It is well suited for use with QuickTime VR. They freely give out their SDK,which we will use.Reality Fusionhttp://www.realityfusion.com/Reality Fusion makes a computer video camera application that allows one touse the body space of the user for control of the computer. They supply a SDKand also a demo version of the software. This software is highly suited for thelibrary because it makes use of the space around the user for control.Cardiff Softwarehttp://www.cardiff.com/Cardiff Software makes a product that allows one to create forms using the .PDFformat. The library uses .PDF extensively, both for the display devices and alsoas the storage type for the library server. This product would be ideal for use onthe library web site for this purpose. There seems to be no licensing difﬁcultiesexcept that they require a one-week training session.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Blue Angel Technologyhttp://www.blueangeltech.com/Blue Angel Technology makes software that implements the ISO standard for auniversal query engine. Although we will be using .PDF as the libraries nativestorage format, we may still take advantage of any existing code that we canmodify for our purposes.SFS Softwarehttp://www.siteforum.com/SFSS software has several products useful for the library. SiteEater, useful forthe server, allows one to have local copies of web sites. InternalWeb creates afull text search index for any downloaded sites (via SiteEater). We most likely willneed a developers license because the products, as is, have their own interfacesthat may be incompatible for our purposes.D-Lib Magazinehttp://www.dlib.org/projects.htmlLibrary science research on digital libraries is extensive and diverse. D-LibMagazine is a good conduit for possible cooperation with the many organizationssuch as government agencies and universities that are studying Digital Libraries.Dimension Technologies Inc., (DTI)http://www.dti3d.comDTI makes a lenticular coating for LCD monitors that allow a user to view 3Dwithout the use of glasses. This is important for the library because, although wewant the user to view and use 3D content on the Internet, we do not want toconstrict him in any way. He must be free to use the entire space available to himin the library.Section VII: TasksHow do we begin? Building a sophisticated system such as the Digital andPortable AiDigital Library will require several major tasks. This section will look atthe problem of construction and specify the various tasks needed to build it.Some of these will be to build the hardware network backbone that will connectto the Internet and other broadband information channels to the library. Otherswill be for creating the software required both to connect the network to theProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
AiDigital Library, and also to build the Advance Concept Tools. A large task will beto devise or integrate a query engine into the Library. Another will be to developthe Library Server software. The server software will need to selectively selectand store the information that will stream across the network. To start off with theﬁrst task will be the creating of the Library Server software. The Server Software:Description:Task Description:Programmer Requirements:Section VIII: Other IssuesConcerning the Oxygen ProjectThis is a large (est. $10 million) project from the AI group at MIT whose purposeis to come up with the most integrated use of transmission technology - resultingin a variety of household objects that a person could query in a natural languagecontext. In many ways this can be viewed as a generalized AiDigital Library.However in this case the environment is expanded to include every possiblespace a human may interact in. This project is devised with technology projectedto be available in about ten years. Obviously it is not pertinent to our effort inmaking commercially successful Internet products now. One thing that perhapsmay be useful to us is their work on command language parsing. This might beavailable under a technology transfer program.ProﬁtabilityAs designed, the AiDigital Library in itself has a limited market because of itscost. Some such markets are the government, petrochemical companies, andmedical research groups. What it was designed for was to provide features thatcould be marketed independently of the AiDigital Library. What this means is thatwhile we hope that the AiDigital Library by itself will be marketable; we expectthat some Advance Concept Tools will be marketable.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Appendix A: White Paper CommentsThis document is the combined effort of a variety of people. The writer (DanielDelgado) served as an editor of all the great ideas, which from all the people whocontributed in some way or another. The creator of the concept of an AiDigitalLibrary, its major designer and supporter, is Gordon Kraft. Chris King, alsoprovided major input. As well as Ralph P. Manfredo of BroadBand NetworksCorporation.This document is our blueprint for the AiDigital Library, and also the conclusion ofthe serious discussions and careful thought processes that went into designing it.As such, this document is also continuously in the process of being revised andexpanded as new input and more decisions are made. This appendix listsvarious recommendations about the white paper for discussion. It is in anappendix because it is not intended to be seen except for those involved it itscreation.Section on Business Relationships:Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Our connections to the various individual and companies are very important. Itwould help us to clarify who and why we need any such relationship. This hasbeen implemented as Section VIII: Potential Business Associates.Digital Presentation of the white paper:This document is intended to be as complete and detailed as possible so as toserve as the blueprint for the construction of the Center and the AiDigital Library.Its detail makes it unsuitable as a marketing tool. We can resolve this by having ahigh-level digital presentation. It would be high-level so as to get the essentialconcepts across to our audience, yet not loose them in the detail. It would bedigital because this would allow us the most possible audience. The presentationcould be done as a PowerPoint demonstration, and/or as a well-done multimediaCD-ROM.Revision and editing by a professional technical writer:Without question, this document must be as clear and as well written as possible.This document will be shown to potential business partners and investors. Itspresentation must also be excellent for the same reason. It is important enoughso as to let a professional technical writer edit and revise it.Library research expert (digital):Considering the difﬁculties mentioned in building a universal library query engine,we should identify a partner or afﬁliation with that expertise. In addition to thebeneﬁts derived from a technology transfer, we could also use this for marketingand other support. Current candidates for such partners are those companiesthat build search engine type software (e.g. Blue Angel Technology: http://www.blueangletech.com/). The other choice is an afﬁliation with a research groupsuch as found in a university or government agency.Internet use of Library for surveys and usability testing:Would it be feasible to give access to the basic library (free) in order to gain alarge user email list - in exchange for surveys and usability testing? If yes, thenlevels should be created for whatever functionality is offered. There is where theproﬁtability begins - at what level, at what point and at what cost? The librarycould represent the initial acceptance of the user and notify us that the library hasbecome useful and important.Top ten site access is needed:There are lists available that give you the top ten web sites visited on theInternet. These should be included in the basic library so se can be assured ofuser, market share. Each of the tops ten should be available in perhaps a richerand more useful environment.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Gordon H Kraft is has been a frequent attendee and panel member of ETRE andATRE conferences. Mr. Kraft currently owns Artiﬁcial, Inc. a Internet Researchand Development Company, and is a private investor in several high techstartups, on their respective Board of Directors. He is the founder of DiagSoft,Inc. which was sold to Sykes, Inc. in Aug. 96. Mr. Kraft has over 35 years ofexperience in the computer industry. Mr. Kraft owned Big Kahuna Productions amultimedia production company located in Maui, Hi. Mr. Kraft has served as VicePresident of Sales and Marketing for Award Software and Condor Computer. Arecognized expert in mainframe, minicomputer, and microcomputer technology.Mr. Kraft has held executive positions at Handle Technologies, Artelonics (ShellOil), Microform Data Systems, Arthur Young & CO., Caelus Memories, FairchildSemiconductor, and GKE Software, which he founded.Hobbies: Mr. Kraft currently owns and races two APBA/SBI Offshore RacingPowerboats and is a member of the new APBA Offshore2000, Inc. Board ofDirectors. (soon to be the Nascar of Offshore Powerboat Racing)The CompanyArtiﬁcial is a private Internet Research and Development company that Mr. Kraftowns. The company is focused on commercializing our previous R&D efforts.Our Phase II - AiDigital Library is currently being prototype.Technology & Market InformationArtiﬁcial developed the following web sites:www.ghklibrary.com!! 3D QTVR AiDigital Librarywww.artiﬁcialinc.com! ! Corporate Sitewww.bigkahuna.net!! Major Hawaiian Portalwww.talkstory.com! ! TalkStory Island CHAT rooms and TalkStory OffshoreRacingwww.avstreams.com! ! prototype Real Video Streaming sitewww.cyberforms.com! ! prototype Avatar site for TalkStory Island CHATroomswww.aiengines.com!! initial Ai research sitewww.moses-tm.com!! GHK investment - USB Home LANwww.bbnc.com! ! ! GHK investment - MPEG2 Video for ATM andInternetwww.star-power.com! ! GHK investment - Home Theater retail chainwww.ghklibrary.com/lazzara/beta! GHK investment - Lazzara YachtsProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
www.apba-offshore.com! ! GHK investment - APBA Offshore Racing!Mr. Kraft utilizes Artiﬁcial, Inc. to assist the GHK investments and provide aprivate “skunk works” for modeling our product visions. Artiﬁcial, Inc. licenses it’sdesigns, copyrights, and trademarks to OEM’s on a “sticker” bundling basis. Thisis very similar to Mr. Kraft’s previous successes at Award Software, where Mr.Kraft created the “sticker” BIOS business, and at DiagSoft for bundling QAPlusDiagnostics to virtually all of the worlds PC manufacturers.Artiﬁcial’s current product focus is on the “Convergence of Hollywood andMicrosoft”. Also know as “Digital Living Rooms.”Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Financial InformationRevenue InformationGHK Investment Fund! $5MMr. and Mrs. Kraft own the GHK Investment Fund.Company Objectives for attending the ConferencesTo meet with my ETRE friends. I am seeking Corporate Sponsors for the APBAOffshore2000, and seeking additional investment capital and potential partners.North America OfﬁcesArtiﬁcial, Inc.889 S. Heathwood Dr.Marco Island, Fl. email@example.com 1.Artiﬁcial Intelligence ResearchProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
MAST, Inc.It was a most profound experience for me intellectually; to have worked with aArtiﬁcial Intelligence company named MAST, Inc.Maui Analysis Synthesis & Technologies (M.A.S.T.) was a “Neural Network”software company, located in Kihei, Maui. MAST was founded by Mr. S. Warricka naval architect, and very brilliant individual. Mr. Warrick, from the northeasternU.S., had moved to Maui partially because of the awesome wind surﬁngconditions present there. Soon thereafter, Mr. Warrick developed the sail designsoftware that Mr. Kraft believes is still the hot ticket in wind surﬁng sail design.MAST had another mainland guy named Mr. P. Billings, a mathematician fromNew Mexico. And a gifted computer programmer, part-time concert pianist, and atop Wind Surfer named Mr. J. Crim. They had developed a Neural Networkprogram called NetCaster that attempted to “predict the S&P 500.” DiagSoft, Inc.Mr. Kraft was the Founder, Chairman/CEO, and Chief Architect of DiagSoft’s PCHardware QA Diagnostics business. At the time of the sale of DiagSoft we hadbundled over 30,000,000 copies of QAPlus, and had over 85% of the worlds PCmanufacturers testing their PC Systems with DiagSoft’s QAPlus Factory QASystem.Mr. Kraft opened DiagSoft’s Paciﬁc Rim HQ just down the hall from MAST. Andsoon thereafter, Mr. C. King and Mr. Kraft founded a Multimedia company called“Big Kahuna Productions” in the Maui Research & Technology (MRTC) building.Mr. Kraft purchased MAST thinking that the addition of Artiﬁcial Intelligence toDiagSoft’s QA products, and his new Electronic Technical Support Center (ETSC)project, and a multitude of other non DiagSoft computer implementations. OnAugust 30, 1996, Mr. Kraft sold DiagSoft, Inc. to Sykes Enterprises in Tampa,Florida. Unfortunately MAST went with the sale. MAST was not supposed to beon the books of DiagSoft. Mr. Kraft had intended to move on with MAST after thesale of DiagSoft, and venture into the general Artiﬁcial Intelligence arena.So without MAST to build on, Mr. Kraft founded Artiﬁcial, Inc. a Floridacorporation. www.artiﬁcialinc.comProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
http://www.ghklibrary.com/aiprojects/ http://www.aiengines.com/Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Artiﬁcial, Inc. Research & Development – 1997(2).! AI Digital Library! ! !The Artiﬁcial, Inc. “AI Digital Library” is an Internet based multimedia virtuallibrary that has the ability to interface with a Crestron Home Theater controlsystem. Mr. Kraft began this project based on my previous expertise inDocument Storage and Retrieval systems integration at Microform Data Systemsin the 70’s, and my expertise in Ofﬁce Automation Workstations and “PaperlessOfﬁces”. www.crestron.com(3). ! GHK Digital LibraryMr. Kraft is an investor in the Dallas based, StarPower Home Entertainment, Inc.retail chain at the request of my friend, Nathan Morton, StarPower’s Chairman.The initial implementation of the AI Digital Library was to create a multimedialibrary replicating a actual old English cherrywood library that Mr. Kraft haveadded to our home. This version is called the “GHK Library”, and can be foundat: www.ghklibrary.com 2.StarPower Home TheaterThe Home Theater Surround Sound experience is an area that Mr. Kraft haspersonally spent substantial time and money on. Mr. Kraft has always been oneof the ﬁrst customers of each new Audio-Video technology introduction. http://www.star-power.com/The AI Digital Library uses an Oracle Video SQL Server for the Storage andRetrieval of the users personal and/or corporate videos. The AI Digital Librarystores all photos, artwork, and all documents in .DOC and .PDF format. Andsince it is Internet based, media and documents can be added from any InternetProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
workstation, and retrieved as well, anyplace in the world... Real Video Streamingand Point MPEG-2 transmission to Multipoint locations is supported.The user(s) therefore have an “Artiﬁcial library with Intelligence”. Hence, aArtiﬁcial Intelligence Digital Library.(5). ! Digital Living RoomsAI Digital Library is also a Internet based “user command interface” to a “DigitalLiving Room”. http://www.digitallivingroom.com/ http://www.software.ibm.com/is/dig-lib/ http://www.ita.sel.sony.com/vaioworld/home.html http://www.zdnet.com/zdnn/stories/zdnn_display/0,3440,2114009,00.html http://www.cedia.org/ 3.Merging Microsoft and Hollywood, the basis of the “StarPower Project”The continued growth path of the PC industry has ﬁnally reached the initialbeachhead of intrusion into the Movie and Television marketplace. Today,Microsoft owns a major interest in NBC Television, as an outgrowth of MSNetwork (MSNBC), which Mr. Kraft expect, will ultimately consume NBCTelevision and others unless the DOJ changes the current course of Microsoft.So now Microsoft has a “Edutainment Channel”.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
9.SummaryThe demand among individual users, home ofﬁce users, and small businessusers for networking and communication solutions is increasing exponentially.The growth in Internet usage and especially with DSL & Cable high speed digitalaccess is fueling this demand, and the further increase in the number of multiplePC homes, and the limited number of networked small ofﬁces is adding todemand. Concurrently, there are numerous cable and USB productmanufacturers as well as network hardware marketers offering partial solutionsBut none of these companies today are offering networking solutions that providethe user with auto installer capabilities of Moses NetAgent even when connectinga single PC such as the network connection of DSL. The installation of DSL isspotty and needs a much better approach in connecting the PC to the Internet,and installing the Ethernet adapter and 10BaseT networking hardware. WithDSL, Moses has a way of integrating all the Ethernet system pieces byconnecting through Moses DSL-Exchange. Moses software then installs andestablishes communications for all devices. In doing the hardware and software,and the combination of both, Moses is the only solution provider offering the endusers a complete solution to their networking and communications needs. Withthis advantage in the marketplace and Moses ability to successfully debut theseproducts, and continue the introduction of new products, Moses will capture asigniﬁcant portion of the growing high-speed access market.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Artiﬁcial, Inc. Plan 99 Internet Research Services Strategic Business Solutions CBT Training Solutions Internet Product R & D Business Analysis ServicesProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Artiﬁcial, Inc. completes 97/98 PlanGordon H. Kraft created Artiﬁcial, Inc., as an Internet based, Research andDevelopment "virtual corporation". Artiﬁcial uses the full capability of theInternet to provide its customers with the most advanced Internetresources.After an exhausting research effort into various Artiﬁcial Intelligence productareas(1), we concluded that the "Internet" offered the best long-term variant ofArtiﬁcial Intelligence. (AI) from a proﬁt generation basis, will provide the best-case scenario for data mining the Internet. We then began our initialdevelopment to create an "artiﬁcial world". As such, we have employed severalhigh-end tools in the development of our sites with the intention to use thesesites as the gateway for building the sites of the future. Tools like Shockwave,Real Video and Audio plus original animations and graphics mixed with live andtaped media will propel artiﬁcial sites beyond the ordinary. Since the inception ofArtiﬁcial Inc., we have pushed the content of our sites and our client sites to themaximum the Internet can provide. The following sites reﬂect our 97/98 R&Defforts:Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
www.artiﬁcialinc.comThe Artiﬁcial Inc corporate site links users to virtually all aspects of our Internetsite development utilizing leading Internet technologies. Included is our own 3DTalkStory Island Palace Chat site connecting island people around the world(nokaoi). This site utilizes Macromedia Flash and integrates all of our sites in anoriginal graphical interface. We utilize Real Video Audio/Visual Video Streaming,and products like NetPodium for wide area business presentations, meetings,and CBT training. Artiﬁcial, Inc. elected Jeffrey O. Kraft as our new President inJune 98. Jeff is responsible for the commercialization of our R&D efforts.www.ghklibrary.comThe GHKlibrary is a state of the art, Apple QuickTime (QTVR/with hotspots)replication of a real SoHo library. Its purpose is for building future custominternet based Home Digital Librarys (HDL)(2), This site is our initial effort todevelop a next generation "what you see is what you get, even if your not athome". And provides its user unparalleled information search and retrieval fromthe Internets vast InfoBase. Unlike desktop routines, which are merely anavigation aid, the GHKlibrary is a web based resource center from which theuser can manipulate both desktop applications and the Internet for a trulyintegrated desktop management tool. While this version of the Library may neversee the light of day as a commercial product, it does show how technology canbe combined into one format. Prior to releasing the Library as a commercialproduct, several key security and product issues must be resolved.The Library was created for the sole purpose of uniting the Internet with thedesktop. As anyone knows who has accumulated ﬁle upon ﬁle of information, ithas become increasingly impossible to catalog this data for future reference.The Library, by use of third party applications, will bring this under control.The real GHKlibrary has a complete Computer Research Lab for creating andtesting of integrated leading Internet technologies(3).Think of it as a huge desk drawer that the user dumps everything that they comeinto contact with. This includes BetaSP/SVHS/Hi8/DVcam Home Video, CDLibrary, DVD Library, Star Power Home Theater(4), and includes a completemultimedia Video Editing Suite, as well as Textual and Graphical info in amultitude of data formats including:MS Word, MS Excel, MS PowerPoint, MS Outlook, Adobe PDF library, MPEG/JPEG/GIF/PhotoShop libraryA IBM Inﬁnity 5500 with dual Pentium II 400 NT Video Server for the home, withover 100GB of hard disk, and DAT backup running an automated home over100T cat 5 LAN.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Microsoft and Intel are also doing R&D on "Digital Living Rooms(5)" which is verysimilar to our StarPower Project(6) of "integrating Microsoft and Hollywood".Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
www.talkstory.comWe believe that our Hawaiian theme of Aloha, embedded in our Internet Chat sitewill continue to grow in valuation. Based on the successful joint interest andinvolvement of our friends throughout Hawaii, this site will grow. TSI was createdto allow those Hawaiians currently living on the Island and off can have a place tochat and share in a comfortable and friendly environment. TSI also employsQuick Time VR, Streaming Audio and Video plus links to our Offshore RacingTeam; “Team Lazzara Offshore Racing”.www.bigkahuna.netWe will create a TalkStory Island Mall providing shop space to our friendscompanies throughout the islands of Hawaii and other Island communitiesthroughout the World. This Mall will be a virtual Mall and therefore will not restrictitself to just one store, but to a multitude of independent stores all thriving lessthan one roof.Oh you thought that TalkStory was limited to the Hawaiian Islands, no bra, dye bemore man.A r t i f i c i a l, I n c.!889 S. Heathwood Dr.Marco Island, Fl. 34145www.avstreams.comAVStreams is a fully video / audio conversant site. What this means is thatAVStreams is a demo site designed to show how video can be played over theInternet for a variety of uses. The main target of this site is to show video can besuccessfully played at common 28.8k modem speeds. The beneﬁt of payingvideo over the Internet is very simple. Video is the best method of providinginteractive training and information to anyone anywhere and at any time. Theuser beneﬁts form having the ability to view instructional data at their leisure andfrom virtually anywhere. The actual application of playing video or audio wouldoccur on the customer site and therefore, the customer has total security of whohas access and what materials are displayed. AVStreams is the host andtechnical link in providing this service.www.lazzarayachts.comProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Lazzara Yachts, one of the premier Mega yacht builders in the world, contractedArtiﬁcial, Inc., to develop a completely new and unique web site. This site wascreated using all of the features Artiﬁcial has promoted and as a result hascreated one of the most striking and interesting sites on the web today. This siteincorporates Palace Chat, Real Video, Streaming Audio, Quick Time animations,privacy areas, document retrieval, customer support and e-commerce. Theprimary purpose of this site is to provide a new level of customer support to theexisting and prospective owners of a Lazzara Yacht. It also has provided a directmethod of communicating to the owners regardless of where they may belocated.AV Streams.com A NEWSLETTERWelcome and Aloha! From Artiﬁcial, Inc. Developers of Virtual Worlds.AVStreams tales full advantage of cutting edge technologies. With full 3D websites, high speed modems, streamed audio and video plus services to back upwe offer, AVStreams is set to take the Internet into the 21st Century. Take fulladvantage of high-end web development and services, AVStreams offers ISDN,SOHO Networking, WEB Publishing, AV Streaming, Encoding and WEBBroadcasting.THE SITEThis site is the ﬁrst of several new sites being developed by Artiﬁcial, Inc., whichwill full advantage of High-Speed (HS) web services. As an indication of ourcommitment to newer and faster technologies, we offer ISDN adapters for 128kInternet access. While viewing multimedia content, this HS access will continueto prove critical over the coming years.Streaming technology can be accomplished in many ways. We have chosen toutilize Real Networks as our platform to present video. The videos shown are alloriginal copyrighted materials for which we retain exclusive rights. To view thesevideos, the user must download the viewer from the Real Network site. We havesupplied a button to accomplish this small task. Video, which is displayed, canbe created in virtually any format and then imported to the Real System. ArtiﬁcialInc. our parent company, is licensed to provide Real Server services to play videothrough our server seamlessly to any web site. What AVStreams offers is notonly this service but complete editing, and encoding services too.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Encoding and Editing ServicesIn addition to hosting video, AVStreams is capable of full editing and encoding ofexisting video. Encoding is a critical piece in presentation of video over the web.Encoding provides for smooth video viewing even at slower modem speeds.When used on high speed networks, video and be viewed at near perfectspeeds. Our encoding service will convert your video for play over the Internet.Encoding also helps in compressing video so less server ﬁle space is utilized.BEACHCAM!AVStreams is fully multimedia enabled. Select any of the buttons to view amultimedia experience. We have added a BeachCAM for your enjoyment. Fromour location on the beach in Capitola Village, California, you can view current realbeach conditions. And yes, it really is from our window. Use of web cameras willcontinue to grow and become common amongst many popular destinations. Ourexample here is to show you how a WEBCAM would appear in your WEB Site.Typical webcam applications could included Safety and Health Training videos,promotional information, special sales information, security cameras and evenvideo conferencing within the site.STREAMED VIDEOProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
When you selected the AVStreams logo, it immediately brought you to a“STREAMED” video. This video is a simple example of the ability Artiﬁcial, Inc.can bring to your web site. By incorporating audio with streamed video or a slideshow, we can signiﬁcantly increase viewer enjoyment. Streamed Audio andVideo can be viewed from this site by selecting any of the icons from the top ofthe screen. Streamed video can be very simple to quite extensive. The framesize shown on our site is set at 640 x 480. We have set the resolution at this sizeto take full advantage of the video and graphics for most users’ capabilities.However, we can design a site to any speciﬁcation. Streaming Video isextremely useful when conducting in house educational programs or merely asinformational video.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
ShowcaseThe example below is a brief demonstration of how a viewer could look. Wehave chosen a drive in theater look. We can design graphics, which couldrepresent your company image or logo. Take a minute to preview the otherstreamed examples to see how we have created custom showcases for thedifferent videos.ISDN and Multi-Point ISDNAnother example of our efforts to provide high-speed high quality is our offeringof ISDN modems. ISDN can increase web access by as much as 50 times overwhat you’re currently experiencing. We offer two types of ISDN products. Theﬁrst product is for single user application. The second is for multi-userapplications. Whether you have a small ofﬁce or home ofﬁce, the multi-point setup can hook up to eight users sharing the ISDN modem. This starter kit providesall the hardware and software necessary to get two PCs up and running on thenet.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Frequently Asked Questions (FAQ)When we created this site, we tried to anticipate all types of questions. Thescreen below is typical of the information we provide.While there may be questions be haven’t answered, we’ve tried to answer thosewhich are asked most commonly. If you have a question we have not answered,please respond by e-mail to webmaster@artiﬁcialinc.com .More News and Press ReleasesWatch this page for more news and upcoming Press Releases. Artiﬁcial, Inc.promises to not leave anyone wanting for information or the latest in WEBdesign. Over the next few months we will be announcing major new web sites,services and promotions. Until then Aloha. And why aloha? It is because ournext web site will feature the islands of Hawaii, its people and its culture. It is ourhope to bring some of that culture to the mainland to be shared.Our next issue will feature video editing and how our services can beimplemented into any organization’s employee development program.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Created and published monthly by Artiﬁcial, Inc. Developers of Virtual WorldsProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Portable Library SpeciﬁcationsThese speciﬁcations are for the Portable Digital Library, which is being built asthe main showcase for the Artiﬁcial Technical Center. Both the Center and theLibrary are explained in detail in the white paper "The Artiﬁcial Technology Centerand the Digital Library", available on the Artiﬁcial Technology web site:http://www.ghklibrary.com/aidl/This document is for the purpose of describing how to build the Portable Library.It is comprised of three sections. The ﬁrst section, Methods, describes thedesired features and then procedures for making them. The second section,Materials, is a list of items to be purchased. The third section, Notes, containsinformation pertinent to the library as a whole. In addition, a schematic overviewof the librarys hardware and software components is shown in Figure 1.MethodsFeature: Moveable Display ScreensDescription: The ability of a user to place the displays in almost any position ororientation desired. This is a fundamental component of the Portable Library.The Portable Library has three main LCD panels for its displays. By positioningthe displays in various conﬁgurations, the user of the Portable Library can use itas either a wide screen system, or a wraparound QTVR viewer, or an out-the-window views such as is used for ﬂight and car simulators (these conﬁgurationsare described separately as individual features). In addition it also allows theuser to use the entire space around him for the Windows Desktop. With this auser can, for example, place ﬁle icons for movies clips above his head, andsound clips next to his left ear.Procedure: Modifying a "Magniﬁer Reading" lamp provides the mechanical armthat supports the Librarys displays:http://www.hammacher.com/DefaultPage/default.asp?ContentPage=/publish/67468.htmThese lamps have a large magnifying lens and are used by people who doprecision miniature work as well as by the sight impaired. Because of theirneeds the mechanical support linkage has been optimized for maintaining thelight and lens at a position of the viewers choice. This is the capability the libraryneeds for its displays.Three lamps are needed. Each is modiﬁed so as to remove the head/lightassembly and substitute it with a LCD display. Depending on the weight of thelamp, we may also replace various springs for ones of higher tension tocompensate for the greater weight of the display.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
To obtain the displays location and orientation in real-time, we use image-processing software provided by Reality Fusion:http://www.realityfusion.com/described in the Materials section. Each display monitors the position of theothers so as to provide a continuous feedback as to its position and orientation.Written with Reality Fusions SDK, a program on the Portable Library calculatesthe display position with respect to the user, and then provides the information toother parts of the library. The library can then access the information in one oftwo ways; either by using Window event messages or by using a shared memorylocation. The conventional method is to use Window event messages. However,it this is not feasible we will resort to a shared memory location. In either case,any program that requires positional information, such as a Java Applet activatedfrom the browser, must make use of the trackers SDK if it needs to access thisinformation.For the out the window simulators, the program will change the display mode toone viewport per display. The different views can then be produce by eitherconﬁguring the software for this arraignment or by running multiple instances ofthe executable, but with different viewing positions (e.g. left, right, and frontviews).For the QTVR and Panoramic viewer, the program will change the display modeto one large viewport with each display mapping into a different portion of theview. This conﬁguration will also be used to enlarge the Desktop to surround theuser.Feature: QTVR ViewerDescription: The QTVR Viewer is a conﬁguration of the library that is optimizedfor the wraparound images of QuickTime VR. The LCD panels are positionedside-bye-side in a semicircle. Such an arrangement can increase the ﬁeld of view(FOV) to as much as 120 degrees. The aim is to give an experience similar tothat of a Circle-rama theater such as is found in Disney Land. Since QTVRimages are used extensively by the library, this will be an important part of theoverall effect of the Portable Library.Procedure: A program will be written that monitors the position of the threedisplays. When the user places them side by side in a semi-circle, the programwill send a Windows event message to all active programs, and also change thedisplay mode to that of one large viewport with each display mapping into adifferent portion of the view. In addition, the size and aspect ratio of eachviewport will be changed to match the FOV of the combined monitors and asystem message will be added that reminds the user to reposition the displayswhen viewing a QTVR image.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Feature: 3D DisplayDescription: The use of the Dimension Technologies lenticular coating allows auser to see volumetric 3D data without any encumbrances such as goggles orLCD shutter glasses:http://www.dti3d.com/With it the user will be able to explore 3D data sets on the Internet using a VRMLbrowser. He will also use it with car and ﬂight type simulations and for watching3D moviesProcedure: The displays must be very lightweight LCD panels. To use theDimension Technologies 3D coating, we must use a LCD panel display becausethe effect depends on the characteristic of liquid crystals to polarize light. To usethe display for the Portable Library, we must also make the displays aslightweight as possible. Weight is an important factor because the Libraryssupport arms are optimized for the weight of its lamp and lens assembly. Ourdisplays must be the same weight or lighter.We will require three displays. They will be bought off-the-shelf, or adapted fromlaptop displays, or built by us. The most convenient way would be to purchasethem, however it is unlikely that we will ﬁnd off-the-shelf displays that meets ourneeds. The next easiest solution is to buy a portable computer and remove itsdisplay, power supply and video circuit board. This may be made moreconvenient by ﬁnding a manufacturer that will sell us just the video componentsfrom its laptop. Regardless, we then substitute long cable assemblies and putonly the LCD panel on the arm, all else will be placed at the base of the arm.If obtaining a manufactured display is not possible, we will buy a LCD panel, avideo interface board, power supply, and build it. This is not very difﬁcult but is amore involved process than the other methods. On the other hand this way doesgive us the advantage of allowing us to select the best and most appropriateparts.After obtaining the displays, we then send them to Dimension Technologies forthem to apply the lenticular coating need for 3D. Since this may take some time(not under our control) we will send the displays to the manufacturer as soon aspossible. Development will then continue using a standard monitor display. Tospeed development, an effective yet costly way would be to obtain an off-the-shelf 3D monitor from Dimension Technologies in addition to the coatings for thelibrarys three displays. The 3D monitor can then be used for development untilthe librarys displays are modiﬁed.Since VRML 3D models are the most common types of 3D objects found on theweb, we will have a VRML browser with 3D capability. The Windows web browserExplorer calls its own VRML browser, but others are easily substituted.Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Hopefully, the Dimension Technologies people know or sell a web browser withbuilt-in 3D support. Otherwise, we will use a well-known VRML browser such asCosmo Player and adapt it for use in the Library.Many simulator games now support 3D viewing. The Portable Library will beable to work with all such games and programs. These are meant to be use withLCD Flicker glasses. The lens go dark then light, only allowing one eye to seean image at any one time, usually at a rate of the display monitor synch (e.g. 60hertz). By presenting to each eye one image of a stereoscopic pair, a fairlyeffective 3D effect is produced. The Portable Librarys 3D coating is compatiblewith this method. We should verify this with MS Flight Simulator and a popularnetwork ﬂight simulator, and some other popular programs.Feature: Panoramic ViewerDescription: The displays are placed side by side for viewing videos with wideaspect ratios such as Panoramic movies. Unlike the QTVR displays, the imagesare not arranged in a semi-circle but as one large ﬂat display.Procedure: Although this is a simple concept, achieving a workable view will bedifﬁcult. When watching movies and looking at images, one should not have aborder along each portion of the image mapped by a display. Yet just about alldisplays have a border along all edges of the display, somewhat like a pictureframe (in the case of a LCD panel, this is probably the display circuit board). Theideal solution is to ﬁnd a display with no borders at least along one dimension.Without this, we may be able to achieve the same effect with real-time opticalcorrection and some type of mirror arrangement. Please see the Addendum:Concerning making a ﬂat display with no gaps (Gordon, I think we might havesome patents here).Regardless of how it is achieved, speech, hand motion, and the touch screen willcontrol the Panoramic Viewer. As with the QTVR viewer, it will make use of the IRposition sensors on the librarys three display support arms. A program will bewritten that changes the display mode to that of one large viewport with eachdisplay mapping into a different portion of the view. Again as with the QTVRviewer, the size and aspect ratio of each viewport will be changed to match theFOV of the combined monitors, and a system message will be added thatreminds the user to reposition the displays when he is viewing a QTVR image.A user will be able to use the Panoramic Viewer for editing and interacting withvideo (such as is done with enhanced DVDs). While watching a news clip theuser could say "stop" followed by "save as example one", which would result in aof a clip of video saved onto the hard drive. He could also use hand motions orthe touch screen to change the speed of the clip. The user will also be able tomanipulate static images. He will be able save an image to disk by using hisProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
ﬁnger to trace around a frozen video segment (such as with a mouse with MSPhoto Editor).Feature: A Friendly LibrarianDescription: The user can easily search both the Librarys material and theInternet without the user needing to know browser commands. It then presentsthe material in a manner appropriate to the media, so for example video is sent tothe Wide Screen TV and audio is channeled to the music system.Procedure: This is a very challenging feature. It must make use of the softwareroutines of every SDK used in the library. Software must be written to allowcontrol with voice, hand gestures, touch screen and keyboard entry. With voicethe user will be able to address the librarian, ask a question, and have packaged"power-point" type presentation of the information. The initial version will try tosimplify the problems by limiting the information and media to that obtained fromthe Internet via the web site of Margaret Anderson:http://www.servtech.com/~mvail/home.html.This allows the program that is parsing the information to make use of a commondata format. A Java/C++ programmer will be used.Even using Margarets web site as a test site, various programs must be writtenand integrated together. First a control program that monitors all I/O, meaningkeyboard, voice, gesture, and desktop commands. Upon activation by thecommand Librarian, which e.g. is done by voice by calling out "Librarian", theprogram must parse the subjects question, and then output one or more browsercommands to obtain the information. Having received it, the program must thenselect the appropriate medium and present the information. The difﬁculty lies ofcourse in programming the presentation.Feature: Hand Motion ControlDescription: The user can control various aspects of the Library hand by usinghand gestures. These are the following: QTVR viewer Video Photographic images MusicHopefully this will be one of the more natural ways for controlling the library. Withthis a person could sweep his hands across a QuickTime VR image and have itrotate around him. He could point to a display icon and launch it by literallymaking a throwing motion or other such gesture. With photos or other graphics,Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
a user can use his hands to pan an image larger then the viewport. For video,the user can use gestures for the editing commands such as stop, fast forward,and reverse. For music, the user can interact with any of the numerousprograms available for creating, conducting and playing music. For example, auser could do such things as change tempo, switch or add instruments, changethe rhythm or turn a page while one plays.Procedure: Software from Reality Fusion will be used for recognizing gestures.This software does a real-time analysis of the video input so as to respond tospeciﬁc hand and body gestures by the user. To use it a small lightweight videocamera facing the user will be attached to each display panel. Using theSoftware Developers Kit (SDK) that has been provided by Reality Fusion, we willwrite software to interface it with the Library. The software will send theappropriate user I/O (most likely emulating ASCII from the keyboard) when itsenses a command gesture. Reality Fusion will be used for the following: QuickTime VR Viewer Melody Assistant (shareware) Microsoft Photo Editor (GIF, JPG and others) QuickTime Viewer (MOV) Microsoft Active Player (MPG)Feature: Speech ControlDescription: The user controls various functions of the Library by voice. Voicecommands will be used for the following: Windows Commands Web browser Library web pages Display settings (brightness, aspect ratio, contrast etc) Video (editing, stop, start, rewind etc.) Music (loudness, bass, treble etc)Procedure: The software ViaVoice will be used for speech control. Like mostvoice recognition systems, it comes with a command set for controlling Windows(such as with ﬁle commands) and also procedures for setting up command setsfor programs. With this we can then give the user control over the displaysettings since they are adjustable by the operating system. Command sets willbe written for the other functions.The ﬁrst command set will be written for the browser since it will be the primaryuser interface. By doing so we add voice commands to the Librarys web pages.To add voice capability for video, music and the display mode, additionalcommand sets will be set up for the most commonly used video and music editorprograms, as well as for changing the display. The programs that will havecommand sets written are the following:Proprietary and conﬁdential ! July 2000! 1Artificial, Inc.
! Microsoft Photo Editor QuickTime Viewer QuickTime VR Viewer! Microsoft Active PlayerAdditional command sets will also be written for the audio player and othermultimedia programs that were provided with to the computer when purchased.For show demonstrations we need to make sure we can use voice independentcommands for at least a subset of those needed. If ViaVoice does not supplythis than we obtain an additional software package that does to be used inconjunction with ViaVoice.Feature: Touch Screen ControlDescription: The user can control the Library using touch screens on its threedisplays. Using the software typically supplied with the screens, the user will beable to select icons, move scroll bars, etc. just as if done by a mouse.Procedure: The touch screen will use an active optical matrix keypad andinterface with the Library computer through the serial port. Tentatively, we will usea display from Intersense Inc.http://www.isense.comThis works by placing optical infrared emitter/transmitters around the perimeter ofthe display. Unlike the pressure sensitive kind, they do not obscure the image.We will also have fewer problems with vibration because they do not require anactual press on the screen. This particular touch screen needs to be tested tosee if it does not interfere with the IR from the head tracker. We may have to usethe pressure sensitive kind if the others infrared system interferes with thetracking system that is used for display and other positional information.Touch screens typically come with software so that a user can control the screenas if it were a mouse. We will use this for most of the functions in the library thatwill make use of the touch screen (those that are mouse like). If the library isusing the displays in a group (such as with QTVR), the touch screen will beactive across all three screens and with one shared viewport.Feature: Three-Camera Viewport.Description: Each of the three LCD displays has a lightweight video cameraattached to it. Used with a good user interface this feature could be one of themore marketable aspects of the library. They provide the beneﬁt of threeviewpoints of the participants in conference. In addition, because a user of theProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Portable Library can reposition the displays and cameras, they can move themso as to interact with other participants.We could greatly enhance the effectiveness of this type of videoconferencing bydesigning utilities that help the user use the three-viewport arrangement. Thesecould include such things as a 3D global display of all participants in one picture,or as a tactile response when remote displays bump into each other.Another thing we could do stereoscopic video conferencing. This is possible inthe Portable Library because all the displays are 3D capable. If the userpositions two of the cameras/displays towards a view, the two images would beused to produced stereoscopic pairs that result in a three dimensional view of thevisual scene.These enhanced video features are well suited for distance learning andteleoperations such as remote surgery.Procedure: A Logitech PC QuickCam will be attached to each display so as toface the viewer:http://www.realityfusion.com/gamecam/about_cam.htmlA Logitech camera is used because it is packaged with the Reality Fusionsoftware:http://www.netsales.net/pk.wcgi/reality/prod/1341273-1Hopefully this means we will have less of a problem interfacing both the cameraand software to LCD displays. The cameras will be connected via a USB port soas to have a small cable footprint. This is necessary to keep the combine weightof the display and camera as low as possible.Feature: Three-dimensional volumetric reconstruction.Description: The user of the library can use the cameras to reconstruct a 3Dvolumetric image of whatever he places in front of the library. If he does this tohimself he is also provided with a 3D analogue suitable for use as an Avatar.Procedure: Several commercial software companies make products thatconstruct a 3D object from pictures of the object from several viewpoints(Gordon, still checking this out). In addition, there is one company, Microlead:http://www.ulead.com/ff/runme.htmthat makes software to wrap a picture of a person intelligibly on a generic 3Dmodel of a head. We obtain these products and hopefully SDKs so as to do thisin real-time in the library.Feature: Head TrackingProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Description: Using a I/R tracking device, the users head position is monitored inreal-time. This is used for creating a Virtual Window display, and also for anyadditional features that may need real-time image processing with respect to theusers eye gaze.Procedure: An I/R tracker from Origin Instruments (DynaSight) will be used toprovide the tracking:http://www.origin.com/We use the tracker primarily to gather real-time data so that we can have arealistic Virtual Window display. This is an impressive feature that we shouldhave. A Virtual Window is a close cousin to my device a Portal Display (and itsbasis). Virtual Windows work by monitoring the head position of the user so thatthe graphics through a window, such as with an airplane, car, and other vehicles,is accurately recreated for the optical path between the user and the scene. Wecreate an out-the-window scene (in 3D because of the Dimension Technologiescoating) such as is needed for a ﬂight or car simulator, where we calculate inreal-time the visual scene using the head and display position and orientationprovided by the tracker. Using this we have a virtual window. The tracker willalso be used in any features that involve a real-time optical correction of thedisplay image.MaterialsHardware Window 95 machine optimized for graphics and as fast as possible (700 MHz) with monitor (TBD) Three PCI graphic cards, OpenGL capable with NTSC out (TBD) Three display support and position systems Three very lightweight LCD displays (TBD) Three IR Touch Screens (TBD) Lenticular stereoscopic coating for LCD displays Three very lightweight video cameras A Multi sensor IR tracking system A high speed Internet connection (TBD)Software:! ViaVoice (IBM) Reality Fusions SDK SDK for IR tracking system FaceMaker Melody Assistant SDK for the touch screenProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Microsoft Photo Editor QuickTime Viewer QuickTime VR Viewer! Microsoft Active Player! Friendly Librarian control interfacesCompaniesDisplay supports: Hammacher Schlemmerhttp://www.hammacher.com/DefaultPage/default.asp?ContentPage=/publish/67468.htmInfrared 3D tracker: Origin Instrumentshttp://www.origin.com/Gesture and Display Position Software: Reality Fusionhttp://www.dti3d.com/Display video cameras: Logitechhttp://www.realityfusion.com/gamecam/about_cam.htmlDigital Librarian: Margaret Andersonhttp://www.servtech.com/~mvail/home.html3D-face reconstruction: MicroLeadhttp://www.ulead.com/ff/runme.htm3D Lenticular Coating: Dimension Technologieshttp://www.dti3d.com/Voice Recognition: IBM ViaVoicehttp://www-4.ibm.com/software/speech/howtobuy/index.htmlMusic composing and playback: Myriad Software (AKA Guillion Bros. Software)http://www.myriad-online.com/Home Control Software: Crestron Remote Control Systemshttp://www.m-media.com/crestron_expan.htmlTouch Screen: Intersense Inc.http://www.isense.comComputer Workstation: Microspherehttp://www.microsphere.comProprietary and conﬁdential ! July 2000! 1Artificial, Inc.
Cost: Windows PC !! ~3000.00 Graphics cards ! 3 @ ~350.00 Monitor arms ! ! 3 @ 275.00! LCD coatings ! ! 3 @ ~13000.00 Video Cameras! 3 * 129.00 IR Touch Screen! firstname.lastname@example.org IR tracking system! 2890.00 Internet connection !TBD Software Librarian! TBD FaceMaker! ! 25.00 Reality Fusion! ! 49.00 IBM ViaVoice!! 149.99Notes:Concerning a ﬂat display with no gaps: As was pointed out in describing thePanoramic Viewer, to do so out of multiple displays requires a display with noborder. At this point, I am not aware of any available. This is surprising.There must be a great demand for this characteristic in a display. This featurecould be used by all the stadiums and large events to make extremely largeconﬁgurable displays of any type they need (a display is an analog of a pixel,more pixels more display). We should investigate further to see if this may be aproﬁtable product.Unfortunately, as of right now I do not know of a way to solve this problem forsuch a market. In the more limited case of the Portable Library, we have thesituation of having only three monitors that can be placed in a side by sidearrangement. We may be able to use mirrors and a rearrangement of theviewport to accomplish this. I will present a small article if the interest is there.Concerning the serial ports: As speciﬁed, almost all the I/O is done via the serialport. We should however explore the use of other faster communicationmethods, for example Firewire. The serial ports are speciﬁed to insure a baselinelevel of communication so as to reduce unknowns and ensure success. A lighter,perhaps wireless, video transmission of high resolution would be the mostdesirable.Concerning the motion trackers:As currently envisioned, the Portable Digital Library will have two separate waysof capturing the users position as well as his gestures. In one way, we make useof the Reality Fusion software to input a users commands as well as to keepProprietary and conﬁdential ! July 2000! 1Artificial, Inc.