AiLibrary Whitepaper 2

The Artificial Technology Center
AiDigital Library ™

Proprietary and conﬁdential ! July 2000! 1
Artificial, Inc.

Author: Daniel Delgado
Aug. 31, 1999
Revised: Gordon H Kraft
July 5, 2000
Oct. 9, 2001
(c) COPYRIGHT 1999 - 2001 Artiﬁcial, Inc.
Artificial, Inc.

SECTION I: The Artificial Technology Center™ with an AiHome™
What is the Artificial Technology Center?
The Artificial Technology Center (ATC) is to be a new and unique research and
development laboratory. Its purpose is to advance and promote the technology of
high-speed (Broadband) Internet applications. The center will advance the
technology with an innovative research and development series of projects. It will
promote the technology by demonstrating and educating the public as to the new
possibilities offered by a broadband Internet (Bi). The ATC will use a constant
flow of the latest PC and Audio/Video equipment and systems. The ATC will be
built inside of a normal Executive Office Building with the construction of a partial
house (approximately 1200sqft.) with easy to visualize Smart House wiring and
the ability to use the ATC house called a AiHome™ as a retail store, a live
development lab, and a classroom.
Why is it needed?
Artificial, Inc.

The Center is needed for one primary reason - to develop profitable systems for
the Internet of tomorrow. All businessmen are aware of the difficulties in
developing new products. Developing products for the Internet is even more
challenging because no one knows how the Internet will grow and what it will
grow into. We do know that its amazing technological advances have changed
the rules of commerce, yet we do not yet know what those rules have changed
into. Because of this, developing creative and profitable products is much more
difficult on the Internet than in the past.
The Center will be an environment designed to quickly produce new products
and technologies. It takes advantage of the fact that advances in broadband
technology will soon turn the Internet into a high bandwidth network to the home.
These changes will open the door for a host of previously impossible
applications. The Center solves the problem of how to create these different
applications and it also determines if they will be profitable. It does this by
building an environment where an Internet user can use the new applications in a
meaningful and productive way, and where at the same time, we can assess their
usefulness and profitability. The ATC’s environment is available online via the Bi
and is called the AiDigital Library™.
Artificial, Inc.

Gateway Computers
Artificial, Inc.

SECTION II: The AiDigital Library™
What is the AiDigital Library?
The AiDigital Library is conceived as integration, both physically and in the
abstract, of a library with the World Wide Web as it’s bookshelf. The goal is have
an environment consisting of library and web, which fulﬁlls the functions of both
in the most useful and human centered manner possible.
We are building a library because a library, seen as a physical container of
knowledge, has the same function as the Internet - today’s most successful and
powerful container of Knowledge. The Internet has its enormity and timeliness of
information, hyperlinks, plus the well-honed excellence of the various search
engines The library, on the other hand, has the advantage of human comfort
such as windows, chairs, desks, and space. Both however have the same
function, which is to serve us humans in our ability to acquire, manipulate, and
create information.
As the Center’s main tool for product development, the AiDigital Library will serve
multiple roles as think tank, R&D facility, and technology showcase. By building it
we hope not only to demonstrate the advanced capabilities offered by a high
bandwidth Internet, but also to act as a bootstrap and catalytic agent for the
development of commercially successful products.
The AiDigital Library will require innovative hardware and software I/O devices
and solutions. The library must make one’s physical environment a powerful tool
for accessing and manipulating the multitude of information streams present on
the Internet: such as HDTV video, surround sound, hypertext search engines,
and 3D visual data sets. Conversely, it must also allow one to control the physical
Artificial, Inc.

aspects of the library in such a way as to facilitate one’s control of the Internet
and it’s multimedia. Solving these problems, and in general building the library,
will result in the profitable Internet application’s needed for commercial success.
SECTION III: The Components
Overview
The Artificial, Inc. “AiDigital Library” is a ongoing research and development
project aimed at providing the user a multimedia digital library of all of their
documents, photos, and home/corporate videos, as well as the using the internet
as our Global Infobase.
How it’s done
The computer selected is a SONY VAIO computer system with a Pentium IV,
DVD, DV Firewire interface, Macintosh G4 DVDr system, VideoConference
Camera, Color printer, Sony LCD flat panel screen, and a Digital Camera. The
human interface is a local web site using our AI 3D-library QTVR look and feel;
the user can operate everything in the room. From the rack of the Home Theater
equipment in the AI 3D library, the user can access the any of the equipment
using a connection to the AV control system, as well as cruise the internet, or
retrieve and show documents, movies, and images. The Control PC is
Artificial, Inc.

connected to the home Cat 5 network or wireless network and to the Internet via
a Broadband T1/DSL or faster. The performance of the resulting AiHome must
have the ability to transmit and receive full motion video in a minimum of MPEG4
format to a maximum of HDTV format.
The use of various high capacity storage or Mass Storage Devices will be
required to store and retrieve the massive amounts of digital information.
Artificial, Inc.

AiLibrary, Inc.
• A Sony Clie PDA is used as the Remote Control
for the AiLibrary.
Artificial, Inc.

AiLibrary, Inc.
• A Sony Clie PDA is used as the Remote Control
for the AiLibrary.
• You click via finger or stylus the visual item area
of interest.
Artificial, Inc.

Sony AiDigital Library™
Artificial, Inc.

PowerFile™
Artificial, Inc.

PowerFile™ Mass Storage Facility capable of 1 Terabyte per unit (can be
daisychained) connected via Firewire™.
Artificial, Inc.

Macintosh AiDigital Library™
From imagination to reality
Artificial, Inc.

Digital Library Hardware/Software Configuration Diagrams
These diagrams show the information flow through the hardware and software of
the Digital Library. A software box is always inside a hardware box, so, for
example, the Library Server is a large gray box containing the boxes naming the
server software, the AIQuery Engine, the Crestron web software, and the web
browser.
An arrow means a physical connection with the direction being either
unidirectional such as with the audio/video signal going to the Wide Screen
Monitor (red), or bi-directional such as with the Library Personal Computer
Ethernet connection to the server (green).
One thing to notice is that in both diagrams the software AIServer box extends
across the hardware box. This is done to signify that the server is indeed the
server, such that all interactions between the Internet and any software that
needs input or output must pass through it.
In addition, both the Portable Digital Library and the Digital Library are shown
with independent hardware for the speech recognition. The portable one uses an
interface card (which is why its box is inside the server box), while the Digital
Library uses an external serial device (blue). This is done in order to reduce
computational load on the server computer. Speech recognition is a real-time
process so if the load is too great then recognition performance gets too poor.
However we may find a software-only package that avoids this. Using an external
device also simplifies programming since the Digital Server then receives its
speech as a serial ASCII stream.
The ST-COM, ST-I/O, ST-VC hardware boxes are modules need to do serial
communication, bit I/O, and device control (e.g. receiver volume) respectively.
The Digital Library book is a display device with a touch screen used to
manipulate web pages, and must be very simple and light. It does not by itself
have any user input apart from that used in the touch screen. The main user
control will be the touch screen with the display mirroring the server browser, and
also the AI AudioResponse System (AiARS).
The position sensors used on both libraries are for are for virtual windowing.
One cannot use the Reality Fusion camera method for this because it would be
Artificial, Inc.

too slow. Several infrared (non-invasive) systems are available. Another beneﬁt
is that if for some reason the Reality Fusion method is not workable then we can
also use it to obtain the users position.
What will the library consist of?
The AiDigital Library will have a variety of software and hardware components.
They are named the following:
The Physical Library
The Library Web Site
The Library Query Engine
The Library Server
Advanced Concept Tools
The Physical Library
The Physical Library is an actual library. The present one is located in Florida.
The library is comfortable, well lit, spacious, with computer access and a private
collection of books, records, tapes etc. It also contains media players such as a
multimedia capable computer, a HDTV capable large screen monitor, and a
stereo system. Regardless as to how we construct the AiDigital Library, we will
make sure it remains comfortable, spacious and well lit.
The AiDigital Library is not meant to be a replacement for a traditional library, nor
for the creation of a ‘super’ high tech system with lots of bells and whistles.
These may be laudable goals but they miss the point of the AiDigital Library. The
goal is to produce a melding of a library with its Internet counterpart. To do so
successfully, we must maintain those qualities of a traditional library that makes it
enjoyable and easy to use. These include in no small part those that make it
comfortable, spacious, and well lit.
Artificial, Inc.

The Library Web Site
As with the Physical Library, the Library Web Site (version alpha) is active (http://
www.ghklibrary.com/aidl). The Web Site will serve as the main conduit for the
interactions between the user, the Internet, and the Physical Library. Its most
important page is a well-done QuickTime VR rendition of the Physical Library.
This page will have controls and gateways to other control pages, which will
allow the manipulation of the AiDigital Library. For example, if one double clicks
on the image of the stereo system, then a new page comes up with information
about the stereo system as well as controls to manipulate it. Likewise, if one
double clicks on the image of the Wide Screen TV, information about your video
database and controls become available.
Using a web site to control the library give certain advantages. We envision the
AiDigital Library as containing a variety of different displays placed at various
locations in it. Using the web in this fashion allows the user to control any number
of library Internet devices with the same interface and on the different displays.
As such, the web site becomes a universal controller for the user.
The current Physical Library uses software from Crestron Home Control Systems
(http://www.crestron.com/website/index.html) for controlling the home. This
software will also be used for the control of the library from the web site. Its use
will save us development time and assure compatibility with the house. Most
importantly, the system is ideal for web hardware interfacing since it has been
speciﬁcally designed for Internet control. In addition, it is a Java based system,
which makes programming for the library much easier.
The Library Web Site user interface, although doable in Java, will require the use
of Shockwave and Director. Shockwave was used for the construction of the
current web site’s interface, and continuing do so allows for the use of previous
work. Furthermore, Shockwave works with QuickTime VR graphics. Currently,
QuickTime VR type graphics are an important part of the web site since the main
control page is a QuickTime VR graphic. Many similar pages will be needed for
the future development. Fortunately both Apple and Macromedia (http://
www.macromedia.com/shockwave/) have publicly available Software
Development Kits (SDK). Apple released theirs years ago and Macromedia has
just released theirs.
Artificial, Inc.

The Library Query Engine
In a regular library a user is able to arrange his books, music etc. in whatever
arrangement he desires (provided that it’s not the public library!). In addition, he
can and probably will continuously add new material to his library. He could store
these in any fashion he desires, perhaps even randomly. What he most likely will
do is to arrange them in categories and store them in various locations such as
shelves to help him find them in the future. Essentially, he wants space to store
his materials and a method to find them whenever he wants to.
The Library Query Engine is the AiDigital Library’s method for selecting and
storing Internet information that the user wants to select and store. In effect, it
allows a user to do the same as he would in a regular library, however with all the
types of information on the Internet.
As one can imagine, developing a query engine is not trivial because of the
diversity of the media on the Internet and the complexity of categorizing the
information.
A good example is the situation with photo and movie formats. There are many
different forms of media and variations of them, such as the picture formats JPG
GIF, TIFF, and the various movies formats MOV, AVI, MPG etc. A query engine
must be sophisticated enough to decode all these formats and also learn about
any new ones.
A much more difficult problem is how the query engine should categorize
information in a manner pertinent to the user. Consider the example of a GIF
image of a painting. One could categorize it by the colors, history, and even
meaning. One analysis provides seven ways of making a suitable search engine
(http://www.gils.net/showcase/). Some methods are very sophisticated and
require the use of intelligent agents and/or content analysis.
Fortunately, there has been a large amount of government and industrial
cooperation in the making of a universally accepted search engine (e.g., http://
www.dlib.org/projects.html). The result has been a concerted international effort
to develop a world standard for searching for information. The standard is known
as ISO 10163 in all places except the US, where it is more commonly know as
ANSI Z39.50 does. This standard handles text information and also large
complex collections such as found in libraries, universities, and museums (http://
www.gils.net/webz3950.html).
The US government has established the Global Information Locator Service
(GILS) to assist in the development and dissemination of Z39.50 to the World
Wide Web (http://www.gils.net/webz3950.html). The result has been the easy
transfer of the standard to the commercial sector. Among other efforts, GILS
makes available code samples and programming utilities for companies to
implement search engines using Z39.50. One such company, Blue Angel
Technology uses GILS to provide a large amount of the functionality required by
Artificial, Inc.

our engine (http://www.blueangeltech.com/). The AiDigital Library ‘s query engine
could be made in conjunction with this or other such developers so as to save
time and not duplicate efforts.
Artificial, Inc.

The Library Server
In a regular library, the user has shelves in which to store his information. The
Library Server will allow the user to do the same. However not just with text
information as found in books, but with all different sorts of media. The Library
Server will work in conjunction with the Query Engine to store multimedia and
other information in the library. Furthermore, just as in a regular library where one
never has enough shelves, the Library Server should have the most possible
amount of disk space possible to hold all the information the user will store.
The Library Server must, just like the Query Engine, categorize and select
information in an intelligent fashion. Think of what would happen otherwise. All of
us who surf the web invariably save some information. Consequently, all of us
who surf the web will most likely run out of disk space. What prevents this from
occurring all the time is that we save only those bits of information meaningful to
us? The Library Server needs to do the same thing.
In addition to selecting what to save, the Library Server must deal with the format
in which to save it in. The PDF format from Adobe appears to be the best to use
because PDF will be the most common interface output for the display panels.
We might have used Z39.50 since it makes use of a common internal data
format. However on the World Wide Web, the .PDF format is increasingly
Artificial, Inc.

becoming the most favored method of storing documents that need to be
accessed from a web site. In addition, there are a large number of skilled
programmers available with expertise in the .PDF format.
Artificial, Inc.

SECTION IV: Advanced
Concept Tools
Advanced concept tools are possible candidates for commercialization: Each tool
will be carefully examined as to its potential and feasibility. If acceptable, the
concept will then be turned into a working prototype for use in the AiDigital
Library. The library will be shown to the public and their reaction to the tool will be
assessed. Based on this feedback and other more rigorous assessments (such
Artificial, Inc.

as is done in usability testing and human factors), the tool will either be rejected,
or added permanently to the AiDigital Library and developed for the marketplace.
Building a tool is the most central part of the Library because it directly addresses
the issue of profits. Building a tool uses all aspects of the Library. When ideas are
proposed and critiqued, the library functions as a think tank. When a tool is built,
the library functions as a rapid prototype and development lab. Finally, when the
tool is demonstrated in the AiDigital Library, it acts as a marketing agency and a
usability-testing laboratory.
A potential tool must be assessed very carefully and meet certain criteria to be
successful. As previously mentioned, the AiDigital Library can be thought of as
the integration of the Internet to one’s personal environment. It has as least two
functions. First, it allows you to use one’s physical actions to work with the
Internet. Secondly, it allows you to use the Internet to control one’s physical
environment. The library should be comprised of tools that accomplish these
functions. This is a loose criteria, but essential for maintaining the focus on the
AiDigital Library.
Currently, most Internet users explore the Web with a browser on a PC. With the
AiDigital Library, we want this capability and much more. The reason we want
much more is because now, instead of accessing the Internet via one PC, we
have an entire room that we can transform into tools for interacting with the
Internet. Some of these tools will use the room features as control devices for
manipulating the Internet. Others will serve to use the room as a large-scale
addition to the web browser.
The following is a list with descriptions of tools that have been proposed as of
9/19/99:
Tool: The Internet Book.
Description: A flat LCD panel display that allows control of the AiDigital Library
Home Page anywhere in the Library. The device would be very flat, lightweight
and rugged (encased in a cushion or leather padding). At the top left and right
hand corners there would be large arrow buttons. These are used with the
Forward Backward icons in the web browser.
The user goes to where he wants to in the library. Picks up the book and right
away what he sees is the AiDigital Library page. As he manipulates the web site
icons, appropriate responses occur in the various items in the real library. The
interface is the web browser so that there is a little learning curve for the user.
Technically this is easy to implement. The quickest would be to use an industrial
LCD panel with a long cable for connection to the network. If a cable is unwieldy
we might want to go with a PC portable with an IR link to the net. Of course the
IR link speed would not allow for the display to be used for video media, however
that would not be its main use. The user would turn his head up and view the
Artificial, Inc.

movie on the wide screen monitor. The book would be mostly as a room/Internet
controller and use only the local pages.
Tool: Visible Mouse Focus
Description: Mouse Focus refers to the object that is currently selected by a
mouse. In the real world we can also think about having a mouse focus that
mimics the position of the mouse in the web site. This can be implemented in
several ways. One is that as the user moves the cursor to a hot spot (e.g. the
stereo), a spotlight focused on the real object lights up. Another possibility is by a
servo-controlled light. This light would change its position as the mouse moves
on the screen. This may be nicer because the moving light is a closer simile to a
moving mouse than a spotlight turning on. There is also another function that this
tool serves. We can also use it to let the browser select a book from your library.
If the browser knew your books and their location, it could point to a particular
volume when the browser search engine hits include information found in your
library books.
Tool: Reality Fusion
Description: Without a doubt this can be a tremendous enhancement to the
library. Using any common computer video camera, it allows you to use the
subject’s position and posture to control things in the library. The company has a
web site with a demo version that one can download.
http://www.realityfusion.com
It is very low cost, has a SDK, and being a local company, can perhaps be a
valuable resource. Reality Fusion allows a tool called “User Focus”.
Tool: User Focus
Description: This is an extension on the Visible Mouse Focus concept. We can
think of the user as having a ‘mouse focus’ that we want the Internet browser to
be aware of. For example, suppose that the user is choosing and adjusting his
music system. Most likely, he will be standing next to the audio system so as to
adjust the controls. The position next to the music system is a hot site just as the
Web version location is a hot zone for double clicking. Knowing the hot zone can
be very useful for modifying the equipment in preparation for its use. This is
where Reality Fusion’s product is so helpful. We can use it to easily identify
where the user is.
Tool: Voice Recognition
Description: This is an obvious one and must be included. This tool is an
example of a class of tools characterized by the fact that they are not marketable,
yet still are needed for the Library. It is also a very important one because a poor
implementation would be worse then none at all. People get enormously
Artificial, Inc.

frustrated at voice recognition systems that do not work. A careful choice of the
many available must be made to avoid public dissatisfaction with the AiDigital
Library as a whole
Tool: Web Integrated Video Editor for Wide Screen TV
Description: The wide screen TV offers lots of possibilities that will be looked at in
another paper. Here, The tool gives is a non-linear editing capability for movies. It
doesn’t have to be a complete set of controls, just sufﬁcient to allow a user to
stop, review, clip and save. A user could make small pieces of multimedia that
serve as notes, study guides’ etc. For example, suppose the viewer just saw a
news report about something pertinent to his job. The user should be able to
freeze the video, select segments, and create a small video clip. The browser will
serve to let the user manipulate the clips. For example, when the user wants to
select clips to review, he selects their icons and drags them onto the Screen icon
Tool: Virtual Headphones
Description: As the user moves about, the library notes his location and moves
the audio “sweet spot” so that it follows the user. We can use Reality Fusion
technology to obtain the user’s position. The movement of the sweet spot is
possible with PC sound cards that have 3D imaging capability, such as the
SoundBlaster and Gravis cards.
Tool: Video Conferencing
Description: Again an obvious one, not marketable, yet needed. To save
development time, we will use an upper-end turnkey system offered to large
corporations. The magazine AV Video has reviews of these. For public relations,
we might want to get a well-known appropriate celebrity and have him be at the
other end of the conversation during important demonstrations
Tool: Keyed information
Description: Keeping in mind the library metaphor, which connotes an ability to
do research, we should offer some method of keying various parts of the
multimedia stream. For example during video playback, the user should be able
to mark the sequence (as previously described), but he should also be able to
attach a text string used as a key for accessing information. The most natural
way of doing this would use voice recognition. Envision a user looking at a news
clip. He sees something of interest. Speaks “Stop”, “Rewind”, “Play for 10
seconds”, “Save Segment as Conference Example”. Resulting in a video clip
saved to the server.
Artificial, Inc.

SECTION V: The Portable AiDigital Library
The Portable AiDigital Library is an Advanced Concept Tool. It was not mentioned
in the previous section because it merits a detailed description by itself. It will be
the ﬁrst tool to be built and the most complex to date.
The Portable AiDigital Library will be designed so as to allow a person to have as
much functionality of the real AiDigital Library as possible. This tool is needed for
a variety of reasons. In order to market successfully any product arising from the
AiDigital Library, we have to take it to potential customers and tradeshows. The
Portable AiDigital Library is designed for this purpose. In addition, because it is
substantially different than the AiDigital Library (because of its size), it will most
likely result in additional product concepts than the original.
The Portable AiDigital Library will have three separate LCD panels (not counting
the PC display). Each one will be thin, lightweight and mounted on a swiveling
armature, similar to that found in some light-stands. The display panels are
mounted so that one can easily pick one up and reposition it by hand.
The displays have several features. They have touch screens. They have the
Dimension-X overlay (http://www.dti3d.com) that allows 3D imaging. They have
sensors that give the position of the screen with respect to the user.
The display panels form the basics of visualization dome’ that can be rearranged
depending of the type of multimedia to be presented. Here is how we can use
them:
Artificial, Inc.

Functions of the Portable AiDigital Library -
Panoramic images and movies:
The user can put them side to side to form one large display. This can be used to
show movies and images in the wide screen format.
Movie editing:
One can place a movie clip on each display and use the third as a touch screen
control for the editor. The editor could be a video-editing page on the library web
site.
QuickTime VR viewing and control:
If the user arranges them in a half-circle facing him, he would have an excellent
viewer for QuickTime VR images. The displays arranged like this could give up to
about a 120-degree wraparound screen. Viewing a QuickTime VR image, e.g. of
the AiDigital Library web site would be impressive. The touch screens would
allow the user to sweep his hand across the display and literally pull the graphics
to where he wants.
GIS analysis:
If you place a screen looking up and below you, it can act as 3D-terrain viewer
for Geographic Information Systems (GIS). Its application could be in
petrochemical 3D mapping and satellite analysis.
Flight, 3D, and game simulations:
If you place the displays in a front, left, and right formation, they can be used for
car and ﬂight simulators. Used with a standard VRML plug-in, a browser (Cosmo
is the typical one) can act as ‘spaceship’ that one can use to ﬂy through the
VRML space. This is done using the Dimension-X screen coating and the
position sensors on the displays. The Dimension-X allows stereoscopic 3D
displays without the encumbrance of glasses, and the position sensors allow
virtual windowing.
Book and sheet music viewer:
One could place 3 pages of a sheet of music or consecutive pages from a book.
As a sheet music viewer, we can use Reality Fusion technology so that the user
can turn the page using physical motions.
Videoconferencing:
If we add a video camera to each display, we would have a videophone capable
of a conference with multiple views of the participants (maybe useful) or of
anything that they put in front of the cameras (very useful).
Distance Learning:
Artificial, Inc.

Capturing live videos of lectures to a server will allow students in remote
classrooms, distant cities and other far parts of the world the ability to attend
classes at secondary schools, colleges and universities at their convenience.
The server allows not only distance learning but also 'time' learning, in the sense
that they can view the lessons at a time of their choosing. This allows company
employees working on undergraduate or graduate degrees, which must travel on
company business or have to work during critical times, the ability to learn their
lessons even while accomplishing their regular company business. Another
market is in corporate training, military training or any other application where
important information needs to be retrieved when the viewer has available time.
Tool: 3D-scanner station:
If we add a video camera to each display, you could use it to produce real-time
avatars of any object placed in front of the displays. Several companies make
software that takes multiple view of an object, such as with pictures, and
recreates it as a 3D volumetric model. What has not been produced is a real-time
3D volumetric model! This is not necessarily due to it being technically
unfeasible, but rather because without some sort of multiple camera arraignment,
there is no use for such software. The Portable AiDigital Library will have multiple
cameras and so can make use of such software. One company makes a product
that wraps a picture of a person in a smart manner so that it looks realistic.
However, it does this on a generic head model. A combination of this technology
combined with real-time 3D volumetric rendering has great potential, and at the
least would be impressive.
Networking:
There is no reason apart from cost not to have the displays be addressable from
the Internet. This would allow the useful feature of automatic configuration. A
user could just put one of these things close to another, and they would sense
each other's presence and configure the visual displays accordingly.
Section VI: Potential Business Associates
This project will require a variety of technologies, and thus will also required
business relationships with the companies that make those technologies. This is
viewed as another benefit derived from the building of the AiDigital Library. Here
we identify those businesses.
Artificial, Inc.

BroadBand Networks Corporation
http://www.bbnc.com
BroadBand Networks Corporation or BBNC is a company specializing in a variety
of hardware for making broadband transmission possible, primarily for the cable
industry. BBNC is a prime example of the company that the Center was designed
to help. As such, we provide new product concepts and marketing by using their
devices in the AiDigital Library.
Macromedia
http://www.macromedia.com/shockwave/
Macromedia makes Shockwave, which allows multimedia like effects with on the
web. It is well suited for use with QuickTime VR. They freely give out their SDK,
which we will use.
Reality Fusion
http://www.realityfusion.com/
Reality Fusion makes a computer video camera application that allows one to
use the body space of the user for control of the computer. They supply a SDK
and also a demo version of the software. This software is highly suited for the
library because it makes use of the space around the user for control.
Cardiff Software
http://www.cardiff.com/
Cardiff Software makes a product that allows one to create forms using the .PDF
format. The library uses .PDF extensively, both for the display devices and also
as the storage type for the library server. This product would be ideal for use on
the library web site for this purpose. There seems to be no licensing difﬁculties
except that they require a one-week training session.
Artificial, Inc.

Blue Angel Technology
http://www.blueangeltech.com/
Blue Angel Technology makes software that implements the ISO standard for a
universal query engine. Although we will be using .PDF as the libraries native
storage format, we may still take advantage of any existing code that we can
modify for our purposes.
SFS Software
http://www.siteforum.com/
SFSS software has several products useful for the library. SiteEater, useful for
the server, allows one to have local copies of web sites. InternalWeb creates a
full text search index for any downloaded sites (via SiteEater). We most likely will
need a developer's license because the products, as is, have their own interfaces
that may be incompatible for our purposes.
D-Lib Magazine
http://www.dlib.org/projects.html
Library science research on digital libraries is extensive and diverse. D-Lib
Magazine is a good conduit for possible cooperation with the many organizations
such as government agencies and universities that are studying Digital Libraries.
Dimension Technologies Inc., (DTI)
http://www.dti3d.com
DTI makes a lenticular coating for LCD monitors that allow a user to view 3D
without the use of glasses. This is important for the library because, although we
want the user to view and use 3D content on the Internet, we do not want to
constrict him in any way. He must be free to use the entire space available to him
in the library.
Section VII: Tasks
How do we begin? Building a sophisticated system such as the Digital and
Portable AiDigital Library will require several major tasks. This section will look at
the problem of construction and specify the various tasks needed to build it.
Some of these will be to build the hardware network backbone that will connect
to the Internet and other broadband information channels to the library. Others
will be for creating the software required both to connect the network to the
Artificial, Inc.

AiDigital Library, and also to build the Advance Concept Tools. A large task will be
to devise or integrate a query engine into the Library. Another will be to develop
the Library Server software. The server software will need to selectively select
and store the information that will stream across the network. To start off with the
ﬁrst task will be the creating of the Library Server software.
The Server Software:
Description:
Task Description:
Programmer Requirements:
Section VIII: Other Issues
Concerning the Oxygen Project
This is a large (est. $10 million) project from the AI group at MIT whose purpose
is to come up with the most integrated use of transmission technology - resulting
in a variety of household objects that a person could query in a natural language
context. In many ways this can be viewed as a generalized AiDigital Library.
However in this case the environment is expanded to include every possible
space a human may interact in. This project is devised with technology projected
to be available in about ten years. Obviously it is not pertinent to our effort in
making commercially successful Internet products now. One thing that perhaps
may be useful to us is their work on command language parsing. This might be
available under a technology transfer program.
Proﬁtability
As designed, the AiDigital Library in itself has a limited market because of its
cost. Some such markets are the government, petrochemical companies, and
medical research groups. What it was designed for was to provide features that
could be marketed independently of the AiDigital Library. What this means is that
while we hope that the AiDigital Library by itself will be marketable; we expect
that some Advance Concept Tools will be marketable.
Artificial, Inc.

Appendix A: White Paper Comments
This document is the combined effort of a variety of people. The writer (Daniel
Delgado) served as an editor of all the great ideas, which from all the people who
contributed in some way or another. The creator of the concept of an AiDigital
Library, its major designer and supporter, is Gordon Kraft. Chris King, also
provided major input. As well as Ralph P. Manfredo of BroadBand Networks
Corporation.
This document is our blueprint for the AiDigital Library, and also the conclusion of
the serious discussions and careful thought processes that went into designing it.
As such, this document is also continuously in the process of being revised and
expanded as new input and more decisions are made. This appendix lists
various recommendations about the white paper for discussion. It is in an
appendix because it is not intended to be seen except for those involved it its
creation.
Section on Business Relationships:
Artificial, Inc.

Our connections to the various individual and companies are very important. It
would help us to clarify who and why we need any such relationship. This has
been implemented as Section VIII: Potential Business Associates.
Digital Presentation of the white paper:
This document is intended to be as complete and detailed as possible so as to
serve as the blueprint for the construction of the Center and the AiDigital Library.
Its detail makes it unsuitable as a marketing tool. We can resolve this by having a
high-level digital presentation. It would be high-level so as to get the essential
concepts across to our audience, yet not loose them in the detail. It would be
digital because this would allow us the most possible audience. The presentation
could be done as a PowerPoint demonstration, and/or as a well-done multimedia
CD-ROM.
Revision and editing by a professional technical writer:
Without question, this document must be as clear and as well written as possible.
This document will be shown to potential business partners and investors. Its
presentation must also be excellent for the same reason. It is important enough
so as to let a professional technical writer edit and revise it.
Library research expert (digital):
Considering the difficulties mentioned in building a universal library query engine,
we should identify a partner or affiliation with that expertise. In addition to the
benefits derived from a technology transfer, we could also use this for marketing
and other support. Current candidates for such partners are those companies
that build search engine type software (e.g. Blue Angel Technology: http://
www.blueangletech.com/). The other choice is an affiliation with a research group
such as found in a university or government agency.
Internet use of Library for surveys and usability testing:
Would it be feasible to give access to the basic library (free) in order to gain a
large user email list - in exchange for surveys and usability testing? If yes, then
levels should be created for whatever functionality is offered. There is where the
profitability begins - at what level, at what point and at what cost? The library
could represent the initial acceptance of the user and notify us that the library has
become useful and important.
Top ten site access is needed:
There are lists available that give you the top ten web sites visited on the
Internet. These should be included in the basic library so se can be assured of
user, market share. Each of the tops ten should be available in perhaps a richer
and more useful environment.
Artificial, Inc.

Gordon H Kraft is has been a frequent attendee and panel member of ETRE and
ATRE conferences. Mr. Kraft currently owns Artificial, Inc. a Internet Research
and Development Company, and is a private investor in several high tech
startups, on their respective Board of Directors. He is the founder of DiagSoft,
Inc. which was sold to Sykes, Inc. in Aug. 96. Mr. Kraft has over 35 years of
experience in the computer industry. Mr. Kraft owned Big Kahuna Productions a
multimedia production company located in Maui, Hi. Mr. Kraft has served as Vice
President of Sales and Marketing for Award Software and Condor Computer. A
recognized expert in mainframe, minicomputer, and microcomputer technology.
Mr. Kraft has held executive positions at Handle Technologies, Artelonics (Shell
Oil), Microform Data Systems, Arthur Young & CO., Caelus Memories, Fairchild
Semiconductor, and GKE Software, which he founded.
Hobbies: Mr. Kraft currently owns and races two APBA/SBI Offshore Racing
Powerboats and is a member of the new APBA Offshore2000, Inc. Board of
Directors. (soon to be the Nascar of Offshore Powerboat Racing)
The Company
Artificial is a private Internet Research and Development company that Mr. Kraft
owns. The company is focused on commercializing our previous R&D efforts.
Our Phase II - AiDigital Library is currently being prototype.
Technology & Market Information
Artificial developed the following web sites:
www.ghklibrary.com!! 3D QTVR AiDigital Library
www.artificialinc.com! ! Corporate Site
www.bigkahuna.net!! Major Hawaiian Portal
www.talkstory.com! ! TalkStory Island CHAT rooms and TalkStory Offshore
Racing
www.avstreams.com! ! prototype Real Video Streaming site
www.cyberforms.com! ! prototype Avatar site for TalkStory Island CHAT
rooms
www.aiengines.com!! initial Ai research site
www.moses-tm.com!! GHK investment - USB Home LAN
www.bbnc.com! ! ! GHK investment - MPEG2 Video for ATM and
Internet
www.star-power.com! ! GHK investment - Home Theater retail chain
www.ghklibrary.com/lazzara/beta! GHK investment - Lazzara Yachts
Artificial, Inc.

www.apba-offshore.com! ! GHK investment - APBA Offshore Racing!
Mr. Kraft utilizes Artificial, Inc. to assist the GHK investments and provide a
private “skunk works” for modeling our product visions. Artificial, Inc. licenses it’s
designs, copyrights, and trademarks to OEM’s on a “sticker” bundling basis. This
is very similar to Mr. Kraft’s previous successes at Award Software, where Mr.
Kraft created the “sticker” BIOS business, and at DiagSoft for bundling QAPlus
Diagnostics to virtually all of the worlds PC manufacturers.
Artificial’s current product focus is on the “Convergence of Hollywood and
Microsoft”. Also know as “Digital Living Rooms.”
Artificial, Inc.

Financial Information
Revenue Information
GHK Investment Fund! $5M
Mr. and Mrs. Kraft own the GHK Investment Fund.
Company Objectives for attending the Conferences
To meet with my ETRE friends. I am seeking Corporate Sponsors for the APBA
Offshore2000, and seeking additional investment capital and potential partners.
North America Offices
Artificial, Inc.
889 S. Heathwood Dr.
Marco Island, Fl. 34145
gkraft@usa.net
1.Artificial Intelligence Research
Artificial, Inc.

MAST, Inc.
It was a most profound experience for me intellectually; to have worked with a
Artificial Intelligence company named MAST, Inc.
Maui Analysis Synthesis & Technologies (M.A.S.T.) was a “Neural Network”
software company, located in Kihei, Maui. MAST was founded by Mr. S. Warrick
a naval architect, and very brilliant individual. Mr. Warrick, from the northeastern
U.S., had moved to Maui partially because of the awesome wind surfing
conditions present there. Soon thereafter, Mr. Warrick developed the sail design
software that Mr. Kraft believes is still the hot ticket in wind surfing sail design.
MAST had another mainland guy named Mr. P. Billings, a mathematician from
New Mexico. And a gifted computer programmer, part-time concert pianist, and a
top Wind Surfer named Mr. J. Crim. They had developed a Neural Network
program called NetCaster that attempted to “predict the S&P 500.”
DiagSoft, Inc.
Mr. Kraft was the Founder, Chairman/CEO, and Chief Architect of DiagSoft’s PC
Hardware QA Diagnostics business. At the time of the sale of DiagSoft we had
bundled over 30,000,000 copies of QAPlus, and had over 85% of the worlds PC
manufacturers testing their PC Systems with DiagSoft’s QAPlus Factory QA
System.
Mr. Kraft opened DiagSoft’s Pacific Rim HQ just down the hall from MAST. And
soon thereafter, Mr. C. King and Mr. Kraft founded a Multimedia company called
“Big Kahuna Productions” in the Maui Research & Technology (MRTC) building.
Mr. Kraft purchased MAST thinking that the addition of Artificial Intelligence to
DiagSoft’s QA products, and his new Electronic Technical Support Center (ETSC)
project, and a multitude of other non DiagSoft computer implementations. On
August 30, 1996, Mr. Kraft sold DiagSoft, Inc. to Sykes Enterprises in Tampa,
Florida. Unfortunately MAST went with the sale. MAST was not supposed to be
on the books of DiagSoft. Mr. Kraft had intended to move on with MAST after the
sale of DiagSoft, and venture into the general Artificial Intelligence arena.
So without MAST to build on, Mr. Kraft founded Artificial, Inc. a Florida
corporation.
www.artificialinc.com
Artificial, Inc.

http://www.ghklibrary.com/aiprojects/
http://www.aiengines.com/
Artificial, Inc.

Artificial, Inc. Research & Development – 1997
(2).! AI Digital Library! ! !
The Artificial, Inc. “AI Digital Library” is an Internet based multimedia virtual
library that has the ability to interface with a Crestron Home Theater control
system. Mr. Kraft began this project based on my previous expertise in
Document Storage and Retrieval systems integration at Microform Data Systems
in the 70’s, and my expertise in Office Automation Workstations and “Paperless
Offices”.
www.crestron.com
(3). ! GHK Digital Library
Mr. Kraft is an investor in the Dallas based, StarPower Home Entertainment, Inc.
retail chain at the request of my friend, Nathan Morton, StarPower’s Chairman.
The initial implementation of the AI Digital Library was to create a multimedia
library replicating a actual old English cherrywood library that Mr. Kraft have
added to our home. This version is called the “GHK Library”, and can be found
at:
www.ghklibrary.com
2.StarPower Home Theater
The Home Theater Surround Sound experience is an area that Mr. Kraft has
personally spent substantial time and money on. Mr. Kraft has always been one
of the first customers of each new Audio-Video technology introduction.
http://www.star-power.com/
The AI Digital Library uses an Oracle Video SQL Server for the Storage and
Retrieval of the users personal and/or corporate videos. The AI Digital Library
stores all photos, artwork, and all documents in .DOC and .PDF format. And
since it is Internet based, media and documents can be added from any Internet
Artificial, Inc.

workstation, and retrieved as well, anyplace in the world... Real Video Streaming
and Point MPEG-2 transmission to Multipoint locations is supported.
The user(s) therefore have an “Artificial library with Intelligence”. Hence, a
Artificial Intelligence Digital Library.
(5). ! Digital Living Rooms
AI Digital Library is also a Internet based “user command interface” to a “Digital
Living Room”.
http://www.digitallivingroom.com/
http://www.software.ibm.com/is/dig-lib/
http://www.ita.sel.sony.com/vaioworld/home.html
http://www.zdnet.com/zdnn/stories/zdnn_display/0,3440,2114009,00.html
http://www.cedia.org/
3.Merging Microsoft and Hollywood, the basis of the “StarPower Project”
The continued growth path of the PC industry has finally reached the initial
beachhead of intrusion into the Movie and Television marketplace. Today,
Microsoft owns a major interest in NBC Television, as an outgrowth of MS
Network (MSNBC), which Mr. Kraft expect, will ultimately consume NBC
Television and others unless the DOJ changes the current course of Microsoft.
So now Microsoft has a “Edutainment Channel”.
Artificial, Inc.

9.
Summary
The demand among individual users, home office users, and small business
users for networking and communication solutions is increasing exponentially.
The growth in Internet usage and especially with DSL & Cable high speed digital
access is fueling this demand, and the further increase in the number of multiple
PC homes, and the limited number of networked small offices is adding to
demand. Concurrently, there are numerous cable and USB product
manufacturers as well as network hardware marketers offering partial solutions
But none of these companies today are offering networking solutions that provide
the user with auto installer capabilities of Moses NetAgent even when connecting
a single PC such as the network connection of DSL. The installation of DSL is
spotty and needs a much better approach in connecting the PC to the Internet,
and installing the Ethernet adapter and 10BaseT networking hardware. With
DSL, Moses has a way of integrating all the Ethernet system pieces by
connecting through Moses DSL-Exchange. Moses software then installs and
establishes communications for all devices. In doing the hardware and software,
and the combination of both, Moses is the only solution provider offering the end
users a complete solution to their networking and communications needs. With
this advantage in the marketplace and Moses ability to successfully debut these
products, and continue the introduction of new products, Moses will capture a
significant portion of the growing high-speed access market.
Artificial, Inc.

Artiﬁcial, Inc. Plan 99
Internet Research Services
Strategic Business Solutions
CBT Training Solutions
Internet Product R & D
Business Analysis Services
Artificial, Inc.

Artificial, Inc. completes 97/98 Plan
Gordon H. Kraft created Artificial, Inc., as an Internet based, Research and
Development "virtual corporation". Artificial uses the full capability of the
Internet to provide its customers with the most advanced Internet
resources.
After an exhausting research effort into various Artificial Intelligence product
areas(1), we concluded that the "Internet" offered the best long-term variant of
Artificial Intelligence. (AI) from a profit generation basis, will provide the best-
case scenario for data mining the Internet. We then began our initial
development to create an "artificial world". As such, we have employed several
high-end tools in the development of our sites with the intention to use these
sites as the gateway for building the sites of the future. Tools like Shockwave,
Real Video and Audio plus original animations and graphics mixed with live and
taped media will propel artificial sites beyond the ordinary. Since the inception of
Artificial Inc., we have pushed the content of our sites and our client sites to the
maximum the Internet can provide. The following sites reflect our 97/98 R&D
efforts:
Artificial, Inc.

www.artificialinc.com
The Artificial Inc corporate site links users to virtually all aspects of our Internet
site development utilizing leading Internet technologies. Included is our own 3D
TalkStory Island Palace Chat site connecting island people around the world
(nokaoi). This site utilizes Macromedia Flash and integrates all of our sites in an
original graphical interface. We utilize Real Video Audio/Visual Video Streaming,
and products like NetPodium for wide area business presentations, meetings,
and CBT training. Artificial, Inc. elected Jeffrey O. Kraft as our new President in
June 98. Jeff is responsible for the commercialization of our R&D efforts.
www.ghklibrary.com
The GHKlibrary is a state of the art, Apple QuickTime (QTVR/with hotspots)
replication of a real SoHo library. It's purpose is for building future custom
internet based Home Digital Library's (HDL)(2), This site is our initial effort to
develop a next generation "what you see is what you get, even if your not at
home". And provides its user unparalleled information search and retrieval from
the Internet's vast InfoBase. Unlike desktop routines, which are merely a
navigation aid, the GHKlibrary is a web based resource center from which the
user can manipulate both desktop applications and the Internet for a truly
integrated desktop management tool. While this version of the Library may never
see the light of day as a commercial product, it does show how technology can
be combined into one format. Prior to releasing the Library as a commercial
product, several key security and product issues must be resolved.
The Library was created for the sole purpose of uniting the Internet with the
desktop. As anyone knows who has accumulated file upon file of information, it
has become increasingly impossible to catalog this data for future reference.
The Library, by use of third party applications, will bring this under control.
The real GHKlibrary has a complete Computer Research Lab for creating and
testing of integrated leading Internet technologies(3).
Think of it as a huge desk drawer that the user dumps everything that they come
into contact with. This includes BetaSP/SVHS/Hi8/DVcam Home Video, CD
Library, DVD Library, Star Power Home Theater(4), and includes a complete
multimedia Video Editing Suite, as well as Textual and Graphical info in a
multitude of data formats including:
MS Word, MS Excel, MS PowerPoint, MS Outlook, Adobe PDF library, MPEG/
JPEG/GIF/PhotoShop library
A IBM Infinity 5500 with dual Pentium II 400 NT Video Server for the home, with
over 100GB of hard disk, and DAT backup running an automated home over
100T cat 5 LAN.
Artificial, Inc.

Microsoft and Intel are also doing R&D on "Digital Living Rooms(5)" which is very
similar to our StarPower Project(6) of "integrating Microsoft and Hollywood".
Artificial, Inc.

www.talkstory.com
We believe that our Hawaiian theme of Aloha, embedded in our Internet Chat site
will continue to grow in valuation. Based on the successful joint interest and
involvement of our friends throughout Hawaii, this site will grow. TSI was created
to allow those Hawaiians currently living on the Island and off can have a place to
chat and share in a comfortable and friendly environment. TSI also employs
Quick Time VR, Streaming Audio and Video plus links to our Offshore Racing
Team; “Team Lazzara Offshore Racing”.
www.bigkahuna.net
We will create a TalkStory Island Mall providing shop space to our friends
companies throughout the islands of Hawaii and other Island communities
throughout the World. This Mall will be a virtual Mall and therefore will not restrict
itself to just one store, but to a multitude of independent stores all thriving less
than one roof.
Oh you thought that TalkStory was limited to the Hawaiian Islands, no bra, dye be
more man.
A r t i f i c i a l, I n c.!
889 S. Heathwood Dr.
Marco Island, Fl. 34145
www.avstreams.com
AVStreams is a fully video / audio conversant site. What this means is that
AVStreams is a demo site designed to show how video can be played over the
Internet for a variety of uses. The main target of this site is to show video can be
successfully played at common 28.8k modem speeds. The beneﬁt of paying
video over the Internet is very simple. Video is the best method of providing
interactive training and information to anyone anywhere and at any time. The
user beneﬁts form having the ability to view instructional data at their leisure and
from virtually anywhere. The actual application of playing video or audio would
occur on the customer site and therefore, the customer has total security of who
has access and what materials are displayed. AVStreams is the host and
technical link in providing this service.
www.lazzarayachts.com
Artificial, Inc.

Lazzara Yachts, one of the premier Mega yacht builders in the world, contracted
Artificial, Inc., to develop a completely new and unique web site. This site was
created using all of the features Artificial has promoted and as a result has
created one of the most striking and interesting sites on the web today. This site
incorporates Palace Chat, Real Video, Streaming Audio, Quick Time animations,
privacy areas, document retrieval, customer support and e-commerce. The
primary purpose of this site is to provide a new level of customer support to the
existing and prospective owners of a Lazzara Yacht. It also has provided a direct
method of communicating to the owners regardless of where they may be
located.
AV Streams.com
A NEWSLETTER
Welcome and Aloha!
From Artificial, Inc. Developers of Virtual Worlds.
AVStreams tales full advantage of cutting edge technologies. With full 3D web
sites, high speed modems, streamed audio and video plus services to back up
we offer, AVStreams is set to take the Internet into the 21st Century. Take full
advantage of high-end web development and services, AVStreams offers ISDN,
SOHO Networking, WEB Publishing, AV Streaming, Encoding and WEB
Broadcasting.
THE SITE
This site is the first of several new sites being developed by Artificial, Inc., which
will full advantage of High-Speed (HS) web services. As an indication of our
commitment to newer and faster technologies, we offer ISDN adapters for 128k
Internet access. While viewing multimedia content, this HS access will continue
to prove critical over the coming years.
Streaming technology can be accomplished in many ways. We have chosen to
utilize Real Networks as our platform to present video. The videos shown are all
original copyrighted materials for which we retain exclusive rights. To view these
videos, the user must download the viewer from the Real Network site. We have
supplied a button to accomplish this small task. Video, which is displayed, can
be created in virtually any format and then imported to the Real System. Artificial
Inc. our parent company, is licensed to provide Real Server services to play video
through our server seamlessly to any web site. What AVStreams offers is not
only this service but complete editing, and encoding services too.
Artificial, Inc.

Encoding and Editing Services
In addition to hosting video, AVStreams is capable of full editing and encoding of
existing video. Encoding is a critical piece in presentation of video over the web.
Encoding provides for smooth video viewing even at slower modem speeds.
When used on high speed networks, video and be viewed at near perfect
speeds. Our encoding service will convert your video for play over the Internet.
Encoding also helps in compressing video so less server ﬁle space is utilized.
BEACHCAM
!
AVStreams is fully multimedia enabled. Select any of the buttons to view a
multimedia experience. We have added a BeachCAM for your enjoyment. From
our location on the beach in Capitola Village, California, you can view current real
beach conditions. And yes, it really is from our window. Use of web cameras will
continue to grow and become common amongst many popular destinations. Our
example here is to show you how a WEBCAM would appear in your WEB Site.
Typical webcam applications could included Safety and Health Training videos,
promotional information, special sales information, security cameras and even
video conferencing within the site.
STREAMED VIDEO
Artificial, Inc.

When you selected the AVStreams logo, it immediately brought you to a
“STREAMED” video. This video is a simple example of the ability Artificial, Inc.
can bring to your web site. By incorporating audio with streamed video or a slide
show, we can significantly increase viewer enjoyment. Streamed Audio and
Video can be viewed from this site by selecting any of the icons from the top of
the screen. Streamed video can be very simple to quite extensive. The frame
size shown on our site is set at 640 x 480. We have set the resolution at this size
to take full advantage of the video and graphics for most users’ capabilities.
However, we can design a site to any specification. Streaming Video is
extremely useful when conducting in house educational programs or merely as
informational video.
Artificial, Inc.

Showcase
The example below is a brief demonstration of how a viewer could look. We
have chosen a drive in theater look. We can design graphics, which could
represent your company image or logo. Take a minute to preview the other
streamed examples to see how we have created custom showcases for the
different videos.
ISDN and Multi-Point ISDN
Another example of our efforts to provide high-speed high quality is our offering
of ISDN modems. ISDN can increase web access by as much as 50 times over
what you’re currently experiencing. We offer two types of ISDN products. The
first product is for single user application. The second is for multi-user
applications. Whether you have a small office or home office, the multi-point set
up can hook up to eight users sharing the ISDN modem. This starter kit provides
all the hardware and software necessary to get two PCs up and running on the
net.
Artificial, Inc.

Frequently Asked Questions (FAQ)
When we created this site, we tried to anticipate all types of questions. The
screen below is typical of the information we provide.
While there may be questions be haven’t answered, we’ve tried to answer those
which are asked most commonly. If you have a question we have not answered,
please respond by e-mail to webmaster@artiﬁcialinc.com .
More News and Press Releases
Watch this page for more news and upcoming Press Releases. Artiﬁcial, Inc.
promises to not leave anyone wanting for information or the latest in WEB
design. Over the next few months we will be announcing major new web sites,
services and promotions. Until then Aloha. And why aloha? It is because our
next web site will feature the islands of Hawaii, its people and its culture. It is our
hope to bring some of that culture to the mainland to be shared.
Our next issue will feature video editing and how our services can be
implemented into any organization’s employee development program.
Artificial, Inc.

Created and published monthly by Artiﬁcial, Inc.
Developers of Virtual Worlds
Artificial, Inc.

Portable Library Specifications
These specifications are for the Portable Digital Library, which is being built as
the main showcase for the Artificial Technical Center. Both the Center and the
Library are explained in detail in the white paper "The Artificial Technology Center
and the Digital Library", available on the Artificial Technology web site:
http://www.ghklibrary.com/aidl/
This document is for the purpose of describing how to build the Portable Library.
It is comprised of three sections. The first section, Methods, describes the
desired features and then procedures for making them. The second section,
Materials, is a list of items to be purchased. The third section, Notes, contains
information pertinent to the library as a whole. In addition, a schematic overview
of the library's hardware and software components is shown in Figure 1.
Methods
Feature: Moveable Display Screens
Description: The ability of a user to place the displays in almost any position or
orientation desired. This is a fundamental component of the Portable Library.
The Portable Library has three main LCD panels for its displays. By positioning
the displays in various configurations, the user of the Portable Library can use it
as either a wide screen system, or a wraparound QTVR viewer, or an out-the-
window views such as is used for flight and car simulators (these configurations
are described separately as individual features). In addition it also allows the
user to use the entire space around him for the Windows Desktop. With this a
user can, for example, place file icons for movies clips above his head, and
sound clips next to his left ear.
Procedure: Modifying a "Magnifier Reading" lamp provides the mechanical arm
that supports the Library's displays:
http://www.hammacher.com/DefaultPage/default.asp?ContentPage=/publish/
67468.htm
These lamps have a large magnifying lens and are used by people who do
precision miniature work as well as by the sight impaired. Because of their
needs the mechanical support linkage has been optimized for maintaining the
light and lens at a position of the viewer's choice. This is the capability the library
needs for its displays.
Three lamps are needed. Each is modified so as to remove the head/light
assembly and substitute it with a LCD display. Depending on the weight of the
lamp, we may also replace various springs for ones of higher tension to
compensate for the greater weight of the display.
Artificial, Inc.

To obtain the display's location and orientation in real-time, we use image-
processing software provided by Reality Fusion:
http://www.realityfusion.com/
described in the Materials section. Each display monitors the position of the
others so as to provide a continuous feedback as to its position and orientation.
Written with Reality Fusion's SDK, a program on the Portable Library calculates
the display position with respect to the user, and then provides the information to
other parts of the library. The library can then access the information in one of
two ways; either by using Window event messages or by using a shared memory
location. The conventional method is to use Window event messages. However,
it this is not feasible we will resort to a shared memory location. In either case,
any program that requires positional information, such as a Java Applet activated
from the browser, must make use of the tracker's SDK if it needs to access this
information.
For the out the window simulators, the program will change the display mode to
one viewport per display. The different views can then be produce by either
configuring the software for this arraignment or by running multiple instances of
the executable, but with different viewing positions (e.g. left, right, and front
views).
For the QTVR and Panoramic viewer, the program will change the display mode
to one large viewport with each display mapping into a different portion of the
view. This configuration will also be used to enlarge the Desktop to surround the
user.
Feature: QTVR Viewer
Description: The QTVR Viewer is a configuration of the library that is optimized
for the wraparound images of QuickTime VR. The LCD panels are positioned
side-bye-side in a semicircle. Such an arrangement can increase the field of view
(FOV) to as much as 120 degrees. The aim is to give an experience similar to
that of a 'Circle-rama' theater such as is found in Disney Land. Since QTVR
images are used extensively by the library, this will be an important part of the
overall effect of the Portable Library.
Procedure: A program will be written that monitors the position of the three
displays. When the user places them side by side in a semi-circle, the program
will send a Windows event message to all active programs, and also change the
display mode to that of one large viewport with each display mapping into a
different portion of the view. In addition, the size and aspect ratio of each
viewport will be changed to match the FOV of the combined monitors and a
system message will be added that reminds the user to reposition the displays
when viewing a QTVR image.
Artificial, Inc.

Feature: 3D Display
Description: The use of the Dimension Technologies lenticular coating allows a
user to see volumetric 3D data without any encumbrances such as goggles or
LCD shutter glasses:
http://www.dti3d.com/
With it the user will be able to explore 3D data sets on the Internet using a VRML
browser. He will also use it with car and flight type simulations and for watching
3D movies
Procedure: The displays must be very lightweight LCD panels. To use the
Dimension Technologies 3D coating, we must use a LCD panel display because
the effect depends on the characteristic of liquid crystals to polarize light. To use
the display for the Portable Library, we must also make the displays as
lightweight as possible. Weight is an important factor because the Library's
support arms are optimized for the weight of its lamp and lens assembly. Our
displays must be the same weight or lighter.
We will require three displays. They will be bought off-the-shelf, or adapted from
laptop displays, or built by us. The most convenient way would be to purchase
them, however it is unlikely that we will find off-the-shelf displays that meets our
needs. The next easiest solution is to buy a portable computer and remove its
display, power supply and video circuit board. This may be made more
convenient by finding a manufacturer that will sell us just the video components
from its laptop. Regardless, we then substitute long cable assemblies and put
only the LCD panel on the arm, all else will be placed at the base of the arm.
If obtaining a manufactured display is not possible, we will buy a LCD panel, a
video interface board, power supply, and build it. This is not very difficult but is a
more involved process than the other methods. On the other hand this way does
give us the advantage of allowing us to select the best and most appropriate
parts.
After obtaining the displays, we then send them to Dimension Technologies for
them to apply the lenticular coating need for 3D. Since this may take some time
(not under our control) we will send the displays to the manufacturer as soon as
possible. Development will then continue using a standard monitor display. To
speed development, an effective yet costly way would be to obtain an off-the-
shelf 3D monitor from Dimension Technologies in addition to the coatings for the
library's three displays. The 3D monitor can then be used for development until
the library's displays are modified.
Since VRML 3D models are the most common types of 3D objects found on the
web, we will have a VRML browser with 3D capability. The Windows web browser
Explorer calls its own VRML browser, but others are easily substituted.
Artificial, Inc.

Hopefully, the Dimension Technologies people know or sell a web browser with
built-in 3D support. Otherwise, we will use a well-known VRML browser such as
Cosmo Player and adapt it for use in the Library.
Many simulator games now support 3D viewing. The Portable Library will be
able to work with all such games and programs. These are meant to be use with
LCD 'Flicker' glasses. The lens go dark then light, only allowing one eye to see
an image at any one time, usually at a rate of the display monitor synch (e.g. 60
hertz). By presenting to each eye one image of a stereoscopic pair, a fairly
effective 3D effect is produced. The Portable Library's 3D coating is compatible
with this method. We should verify this with MS Flight Simulator and a popular
network flight simulator, and some other popular programs.
Feature: Panoramic Viewer
Description: The displays are placed side by side for viewing videos with wide
aspect ratios such as Panoramic movies. Unlike the QTVR displays, the images
are not arranged in a semi-circle but as one large flat display.
Procedure: Although this is a simple concept, achieving a workable view will be
difficult. When watching movies and looking at images, one should not have a
border along each portion of the image mapped by a display. Yet just about all
displays have a border along all edges of the display, somewhat like a picture
frame (in the case of a LCD panel, this is probably the display circuit board). The
ideal solution is to find a display with no borders at least along one dimension.
Without this, we may be able to achieve the same effect with real-time optical
correction and some type of mirror arrangement. Please see the Addendum:
Concerning making a flat display with no gaps (Gordon, I think we might have
some patents here).
Regardless of how it is achieved, speech, hand motion, and the touch screen will
control the Panoramic Viewer. As with the QTVR viewer, it will make use of the IR
position sensors on the library's three display support arms. A program will be
written that changes the display mode to that of one large viewport with each
display mapping into a different portion of the view. Again as with the QTVR
viewer, the size and aspect ratio of each viewport will be changed to match the
FOV of the combined monitors, and a system message will be added that
reminds the user to reposition the displays when he is viewing a QTVR image.
A user will be able to use the Panoramic Viewer for editing and interacting with
video (such as is done with enhanced DVD's). While watching a news clip the
user could say "stop" followed by "save as example one", which would result in a
of a clip of video saved onto the hard drive. He could also use hand motions or
the touch screen to change the speed of the clip. The user will also be able to
manipulate static images. He will be able save an image to disk by using his
Artificial, Inc.

ﬁnger to trace around a frozen video segment (such as with a mouse with MS
Photo Editor).
Feature: A Friendly Librarian
Description: The user can easily search both the Library's material and the
Internet without the user needing to know browser commands. It then presents
the material in a manner appropriate to the media, so for example video is sent to
the Wide Screen TV and audio is channeled to the music system.
Procedure: This is a very challenging feature. It must make use of the software
routines of every SDK used in the library. Software must be written to allow
control with voice, hand gestures, touch screen and keyboard entry. With voice
the user will be able to address the librarian, ask a question, and have packaged
"power-point" type presentation of the information. The initial version will try to
simplify the problems by limiting the information and media to that obtained from
the Internet via the web site of Margaret Anderson:
http://www.servtech.com/~mvail/home.html.
This allows the program that is parsing the information to make use of a common
data format. A Java/C++ programmer will be used.
Even using Margaret's web site as a test site, various programs must be written
and integrated together. First a control program that monitors all I/O, meaning
keyboard, voice, gesture, and desktop commands. Upon activation by the
command 'Librarian', which e.g. is done by voice by calling out "Librarian", the
program must parse the subject's question, and then output one or more browser
commands to obtain the information. Having received it, the program must then
select the appropriate medium and present the information. The difﬁculty lies of
course in programming the presentation.
Feature: Hand Motion Control
Description: The user can control various aspects of the Library hand by using
hand gestures. These are the following:
QTVR viewer
Video
Photographic images
Music
Hopefully this will be one of the more natural ways for controlling the library. With
this a person could sweep his hands across a QuickTime VR image and have it
rotate around him. He could point to a display icon and launch it by literally
making a throwing motion or other such gesture. With photos or other graphics,
Artificial, Inc.

a user can use his hands to pan an image larger then the viewport. For video,
the user can use gestures for the editing commands such as stop, fast forward,
and reverse. For music, the user can interact with any of the numerous
programs available for creating, conducting and playing music. For example, a
user could do such things as change tempo, switch or add instruments, change
the rhythm or 'turn' a page while one plays.
Procedure: Software from Reality Fusion will be used for recognizing gestures.
This software does a real-time analysis of the video input so as to respond to
specific hand and body gestures by the user. To use it a small lightweight video
camera facing the user will be attached to each display panel. Using the
Software Developer's Kit (SDK) that has been provided by Reality Fusion, we will
write software to interface it with the Library. The software will send the
appropriate user I/O (most likely emulating ASCII from the keyboard) when it
senses a command gesture. Reality Fusion will be used for the following:
QuickTime VR Viewer
Melody Assistant (shareware)
Microsoft Photo Editor (GIF, JPG and others)
QuickTime Viewer (MOV)
Microsoft Active Player (MPG)
Feature: Speech Control
Description: The user controls various functions of the Library by voice. Voice
commands will be used for the following:
Windows Commands
Web browser
Library web pages
Display settings (brightness, aspect ratio, contrast etc)
Video (editing, stop, start, rewind etc.)
Music (loudness, bass, treble etc)
Procedure: The software ViaVoice will be used for speech control. Like most
voice recognition systems, it comes with a command set for controlling Windows
(such as with file commands) and also procedures for setting up command sets
for programs. With this we can then give the user control over the display
settings since they are adjustable by the operating system. Command sets will
be written for the other functions.
The first command set will be written for the browser since it will be the primary
user interface. By doing so we add voice commands to the Library's web pages.
To add voice capability for video, music and the display mode, additional
command sets will be set up for the most commonly used video and music editor
programs, as well as for changing the display. The programs that will have
command sets written are the following:
Artificial, Inc.

! Microsoft Photo Editor
QuickTime Viewer
QuickTime VR Viewer
! Microsoft Active Player
Additional command sets will also be written for the audio player and other
multimedia programs that were provided with to the computer when purchased.
For show demonstrations we need to make sure we can use voice independent
commands for at least a subset of those needed. If ViaVoice does not supply
this than we obtain an additional software package that does to be used in
conjunction with ViaVoice.
Feature: Touch Screen Control
Description: The user can control the Library using touch screens on its three
displays. Using the software typically supplied with the screens, the user will be
able to select icons, move scroll bars, etc. just as if done by a mouse.
Procedure: The touch screen will use an active optical matrix keypad and
interface with the Library computer through the serial port. Tentatively, we will use
a display from Intersense Inc.
http://www.isense.com
This works by placing optical infrared emitter/transmitters around the perimeter of
the display. Unlike the pressure sensitive kind, they do not obscure the image.
We will also have fewer problems with vibration because they do not require an
actual press on the screen. This particular touch screen needs to be tested to
see if it does not interfere with the IR from the head tracker. We may have to use
the pressure sensitive kind if the other's infrared system interferes with the
tracking system that is used for display and other positional information.
Touch screens typically come with software so that a user can control the screen
as if it were a mouse. We will use this for most of the functions in the library that
will make use of the touch screen (those that are mouse like). If the library is
using the displays in a group (such as with QTVR), the touch screen will be
active across all three screens and with one shared viewport.
Feature: Three-Camera Viewport.
Description: Each of the three LCD displays has a lightweight video camera
attached to it. Used with a good user interface this feature could be one of the
more marketable aspects of the library. They provide the beneﬁt of three
viewpoints of the participants in conference. In addition, because a user of the
Artificial, Inc.

Portable Library can reposition the displays and cameras, they can move them
so as to interact with other participants.
We could greatly enhance the effectiveness of this type of videoconferencing by
designing utilities that help the user use the three-viewport arrangement. These
could include such things as a 3D global display of all participant's in one picture,
or as a tactile response when remote displays 'bump' into each other.
Another thing we could do stereoscopic video conferencing. This is possible in
the Portable Library because all the displays are 3D capable. If the user
positions two of the cameras/displays towards a view, the two images would be
used to produced stereoscopic pairs that result in a three dimensional view of the
visual scene.
These enhanced video features are well suited for distance learning and
teleoperations such as remote surgery.
Procedure: A Logitech PC QuickCam will be attached to each display so as to
face the viewer:
http://www.realityfusion.com/gamecam/about_cam.html
A Logitech camera is used because it is packaged with the Reality Fusion
software:
http://www.netsales.net/pk.wcgi/reality/prod/1341273-1
Hopefully this means we will have less of a problem interfacing both the camera
and software to LCD displays. The cameras will be connected via a USB port so
as to have a small cable footprint. This is necessary to keep the combine weight
of the display and camera as low as possible.
Feature: Three-dimensional volumetric reconstruction.
Description: The user of the library can use the cameras to reconstruct a 3D
volumetric image of whatever he places in front of the library. If he does this to
himself he is also provided with a 3D analogue suitable for use as an Avatar.
Procedure: Several commercial software companies make products that
construct a 3D object from pictures of the object from several viewpoints
(Gordon, still checking this out). In addition, there is one company, Microlead:
http://www.ulead.com/ff/runme.htm
that makes software to wrap a picture of a person intelligibly on a generic 3D
model of a head. We obtain these products and hopefully SDK's so as to do this
in real-time in the library.
Feature: Head Tracking
Artificial, Inc.

Description: Using a I/R tracking device, the users head position is monitored in
real-time. This is used for creating a Virtual Window display, and also for any
additional features that may need real-time image processing with respect to the
users eye gaze.
Procedure: An I/R tracker from Origin Instruments (DynaSight) will be used to
provide the tracking:
http://www.origin.com/
We use the tracker primarily to gather real-time data so that we can have a
realistic Virtual Window display. This is an impressive feature that we should
have. A Virtual Window is a close cousin to my device a Portal Display (and its
basis). Virtual Windows work by monitoring the head position of the user so that
the graphics through a window, such as with an airplane, car, and other vehicles,
is accurately recreated for the optical path between the user and the scene. We
create an out-the-window scene (in 3D because of the Dimension Technologies
coating) such as is needed for a ﬂight or car simulator, where we calculate in
real-time the visual scene using the head and display position and orientation
provided by the tracker. Using this we have a virtual window. The tracker will
also be used in any features that involve a real-time optical correction of the
display image.
Materials
Hardware
Window 95 machine optimized for graphics and as fast as possible (700
MHz) with monitor (TBD)
Three PCI graphic cards, OpenGL capable with NTSC out (TBD)
Three display support and position systems
Three very lightweight LCD displays (TBD)
Three IR Touch Screens (TBD)
Lenticular stereoscopic coating for LCD displays
Three very lightweight video cameras
A Multi sensor IR tracking system
A high speed Internet connection (TBD)
Software:!
ViaVoice (IBM)
Reality Fusion's SDK
SDK for IR tracking system
FaceMaker
Melody Assistant
SDK for the touch screen
Artificial, Inc.

Microsoft Photo Editor
QuickTime Viewer
QuickTime VR Viewer
! Microsoft Active Player
! Friendly Librarian control interfaces
Companies
Display supports: Hammacher Schlemmer
http://www.hammacher.com/DefaultPage/default.asp?ContentPage=/publish/
67468.htm
Infrared 3D tracker: Origin Instruments
http://www.origin.com/
Gesture and Display Position Software: Reality Fusion
Display video cameras: Logitech
http://www.realityfusion.com/gamecam/about_cam.html
Digital Librarian: Margaret Anderson
http://www.servtech.com/~mvail/home.html
3D-face reconstruction: MicroLead
http://www.ulead.com/ff/runme.htm
3D Lenticular Coating: Dimension Technologies
Voice Recognition: IBM ViaVoice
http://www-4.ibm.com/software/speech/howtobuy/index.html
Music composing and playback: Myriad Software (AKA Guillion Bros. Software)
http://www.myriad-online.com/
Home Control Software: Crestron Remote Control Systems
http://www.m-media.com/crestron_expan.html
Touch Screen: Intersense Inc.
http://www.isense.com
Computer Workstation: Microsphere
http://www.microsphere.com
Artificial, Inc.

Cost:
Windows PC!! ~3000.00
Graphics cards ! 3 @ ~350.00
Monitor arms ! ! 3 @ 275.00!
LCD coatings ! ! 3 @ ~13000.00
Video Cameras! 3 * 129.00
IR Touch Screen! 3@309.00
IR tracking system! 2890.00
Internet connection !TBD
Software Librarian! TBD
FaceMaker! ! 25.00
Reality Fusion! ! 49.00
IBM ViaVoice!! 149.99
Notes:
Concerning a flat display with no gaps: As was pointed out in describing the
Panoramic Viewer, to do so out of multiple displays requires a display with no
border. At this point, I am not aware of any available. This is surprising.
There must be a great demand for this characteristic in a display. This feature
could be used by all the stadiums and large events to make extremely large
configurable displays of any type they need (a display is an analog of a pixel,
more pixels more display). We should investigate further to see if this may be a
profitable product.
Unfortunately, as of right now I do not know of a way to solve this problem for
such a market. In the more limited case of the Portable Library, we have the
situation of having only three monitors that can be placed in a side by side
arrangement. We may be able to use mirrors and a rearrangement of the
viewport to accomplish this. I will present a small article if the interest is there.
Concerning the serial ports: As specified, almost all the I/O is done via the serial
port. We should however explore the use of other faster communication
methods, for example Firewire. The serial ports are specified to insure a baseline
level of communication so as to reduce unknowns and ensure success. A lighter,
perhaps wireless, video transmission of high resolution would be the most
desirable.
Concerning the motion trackers:
As currently envisioned, the Portable Digital Library will have two separate ways
of capturing the user's position as well as his gestures. In one way, we make use
of the Reality Fusion software to input a user's commands as well as to keep
Artificial, Inc.

track of the position of the displays. In the other way, we make use of an
infrared tracking system, typically by tracking a small IR reﬂective dot on the
person's head in real-time.
The IR tracker is an expensive item, and one may think it overkill just to track the
user's head position. However other methods, such as mechanical resistance
measures or magnetic ﬁeld monitors etc. all require tethers, in addition some
would require substantial engineering to integrate them into the library.
Since we do have another method (Reality Fusion), one may ask why not use it
for the head tracking. The software is sophisticated enough to follow and
recognize a person's hand gestures. This is done by a real-time analysis of a
video image (from a typical inexpensive video cam) of the user.
Unfortunately, since it is a software DSP process, it currently is too slow to use at
a 60-Hertz rate. However in the future I think that this method is the one most
likely to be useful in a commercial market.
For the library, we use the Reality Fusion video system for other functions, most
prominently as a user interface to the web browser and the video/audio controls
of the portable library. The software is being continually revised and with a very
well supported SDK. It used to be available free of charge, but we now need a
developer's agreement of some sort:
http://www.realityfusion.com/sdk.htm
(Gordon, I will email it when received). An additional use of the Reality Fusion
software is unique to the Portable Library. The three displays will each have a
separate video camera. This will be used not only to obtain the user's gestures,
but also of themselves. This will allow the library to change the video display
format (size of desktop, etc) to the correct one for the three main display formats
(QTVR viewer, Panoramic Viewer, OTW simulation). It may also allow for the
use of the displays as Portal Displays, since although the main requirement is a
real-time analysis of both the viewers and the display's position, the display
position needs much less bandwidth than that of the user's.
One may ask why we could not make use of the IR tracker for the display
positions. Unfortunately, the cost per sensor and tracker makes it very expensive
and not cost effective. In addition to the price per sensor, we might have to buy
an additional IR tracker. Tracking the monitors with the IR sensor will require
more sensors than are available on one unit. We would then have the added
expense of buying two I/R trackers. Using of the Reality Fusion method is
substantially more cost effective then using an IR tracker.
Artificial, Inc.

Figure 1: Portable Library Hardware/Software Conﬁguration
This diagram shows the information ﬂow through the hardware and software of
the Portable Digital Library. A software box is always inside a hardware box, so,
for example, the Library Server is a large gray box containing the boxes naming
the server software, the AIQuery Engine, the Crestron web software, and the web
browser.
An arrow means a physical connection with the direction being either
unidirectional such as with the audio/video signal going to the Wide Screen
Monitor (red), or bi-directional such as with the Library Personal Computer
Ethernet connection to the server (green).
One thing to notice is that the software AIServer box extends across the
hardware box. This is done to signify that the server is indeed the server, such
that all interactions between the Internet and any software that needs input or
output must pass through it.
The ST-COM, ST-I/O, ST-VC hardware boxes are modules need to do serial
communication, bit I/O, and device control (e.g. receiver volume) respectively.
The Digital Library book is a display device with a touch screen used to
manipulate web pages, and must be very simple and light. It does not by itself
have any user input apart from that used in the touch screen. The main user
control will be the touch screen with the display mirroring the server browser, and
also the AI AudioResponse System (AiARS).
The position sensors are for monitoring the location of the displays, and also
allow for virtual windowing if used in conjunction with a head sensor. One cannot
use the Reality Fusion camera method for this because it would be too slow.
Artificial, Inc.

Audio System
Continous Speech Recognizer
AiARS
Crestron Web Software
Video Camera
Web Browser
AI Query Engine
Library Personal Computer
A/V Splitter Switcher
Reality Fusion
Position Sensors
Digital Library Book
Touch Screens
AI Server
Server Computer: Fred
Wide Screen Monitor
Broadband Cable
Internet
Digital Library Hardware/Software
Conﬁguration
Artificial, Inc.

AiLibrary Ver.!PDAsw! Setup!Month Fee! Annual Fee! ! Annual
Income! ! No. Users! Total Income
AiOne!29.95! 500! 9.95! 119.4! ! 649.35! ! 1500! 974025
AiTwo!29.95! 750! 19.95! 239.4! ! 1019.35! ! 200! 203870
AiThree! ! ! ! ! ! ! ! !
AiFour!! ! ! ! ! ! ! !
AiFive!! ! ! ! ! ! ! !
! ! ! ! ! ! ! ! !
! ! ! ! ! ! ! ! ! 1177895
Artificial, Inc.

AiLibrary Whitepaper 2

More Related Content

What's hot

Similar to AiLibrary Whitepaper 2

More from Gordon Kraft

Recently uploaded

AiLibrary Whitepaper 2