Multi Actions Multi interactive System

Hardware Information
Hardware:
This system (solution) is possible due to a interconnection of a emitting device, a acquisition device, a processing unit and the projection of the result.

Image acquisition

Filter

CPU Projection

Emitting Devices

Any Projection Surface

The hardware concerns are the major issue for success in this project. The devices used, should be suitable for a general/massive solution, Each projector and each camera have technical specifications. For our project the information that is crucial in the angle of opening of the projector and the camera. To a specific video projector, it is viable to make adjustments to lenses that allow a 100% mapping of the image. (See pictures above). For this solution using a ordinary long video projector ,and a Microsoft HD webcam,we have a map 1x1 at 935 mm of the projection surface. This means that 1 mm(millimeter) is mapped by 1 pixel of the picture, allowing a short 1 mm error when using the IR pen. The reasonable values of mapping are at most 3mm * 1 px, because of the size of the pen used. Therefore, the camera should always have a resolution and distance adjusted to the values in each case. For a bundle product, the measures of positioning the camera should be provided by the supplier, regarding that, if the camera is capturing using 800x600 (px) , should use a distance that allows at least a image (projected area) of 1600x1200 (mm) for a good operation of the system (in this limit situation the camera should just see the projected area, and not include surrounding area.)

Good Adjustment Camera and Projector;

Resolution Loss.

Software Information
The software (we provide source files), creates a interface between the hardware and the application software proprietary to the company.
This software is not intended to operate as it is. It is provided as a demonstration procedure that simulates the tracking process and usability in writing applications and in operating system Windows 7. There are procedures that are made with manual intervention, but that are intended to be automated in the final integrated application with simple programming routines.

ATTENCION: All testings should be made using 1024x768 as screen resolution!

(Once more this is a test method, the final solution will be multi resolution and auto detects the size of screen used!)

Setup Process:
Now, we explain how to install our software Demo.

1 The installation is a standard one, and should be made carefully due to the specifications of this application.

2 When completing the installation, special cares should be followed, because there are security routines made for the correct operation of the software in windows.

If a message appears for allowing the installation of a driver you MUST ALLOW IT! If you do not allow it, please repeat the setup. After the driver is installed you must press a key to continue and then the setup finishes. As they are used communication routines inside windows, the correct rules must be defined/ created in windows firewall or any other else (this could be the main issue for an incorrect functioning of the application). At this time pay attention to security questions of windows. In network matter, you must allow access to the PRIVATE and PUBLIC Networks, because of the protocols used!

After the setup finishes, you must configure windows to accept TUIO messages, therefore a windows is automatically opened for human interaction, authorizing TUIO messages. You should select TUIO and then press the Blue arrow! (This window just appears once). Then you could close it.

(If a command window remains opened after finishing the setup, you should just close it. Its due to the windows driver startup)

REMEMBER: You must allow public and private access in the windows firewall for this application

3 The first time you run the application you should adjust the camera and reception component of the software. For that, you should execute Ivision application (Should be in your start menu or desktop). After opening Ivision:
If you see a message like the above, thats because there is no supported camera connected with the computer, therefore the application cannot initialize.

3-1:
If there is a camera connected and installed in the system youll see a windows for configure the picture capturing.

In our testing, the best results obtained with a standard webcam were for the settings: Framerate: 30.000 Color/Compression: RGB 24 Size of output: 640x480

3-2:
After the settings have been defined you should have a window system like the above one:

The Ivision windows accepts the command keys showed in the adjacent window, therefore the main keys to be used are:

3-2-1: Keyboard key o For making important adjustments to camera settings: (the pictures provided are representative only
of the best results obtained in our testing procedures for our camera, this definitions should be adapted with different distances/light conditions/projected background surface. These settings were configured in a Portuguese windows, so the English equivalent is: Camera Control: Focus : 6 (Remove the Automatic Focus) Zoom : 0 Shift Image : 0 Rotate : 0

Video Definitions: Remove True Color Option Luminosity : 71 White Balance : 5300 (Remove the automatic Option) Saturation : 70 Exposure : -11 (Remove the automatic Option) Contrast : 0 Frequency : 50 Hz (Portuguese electricity frequency)

(These definitions are the intended for testing purposes in the conditions of our equipment and conditions, for any matter, this process is also possible to be very simplified as it always depends in environment)

3-2-2: Keyboard key f Dot size definition and calibration

REMEMBER: The size of the screen should at this time be 1024x768; Use the keys and to adjust the blue ball to the size of the IR dot captured by the webcam. If there are white spots captured by the camera without any IR emitter, then you should review the camera definitions. Then use the IR pen to click for approximately one second in each cross, until it disappears. When the cross quick flashes between blue and red, its because the position of the cursor is not precise (you should correct the size of the dot, or, if the problem remains its because the pen its between pixels and you should adjust slightly the pen). The size of the dot, its also possible to make automatically detectable.

3-3: After calibration you must use once again the key f to minimize the calibration window.

After that you can open the writing software (MultiActionsDemo). REMEMBER: You must allow public and private access in the windows firewall for this application:

At this time if the firewall rules are correct, you should be able to write in the screen using your pen. Try to test the smoothness of the writing and precision. Allow to minimize, clear screen and close.

4: Now using the

minimize button, you should be able to control windows 7 with the infrared pen like a mouse, or pens, zooming in and out of pictures, or making drawings in windows paint (or for that matter using any software that allows native windows multiwriting/multicontrol). After that you could return to drawing software.

Note: The information provided in all this document is extremely confidential and just intended for the destinatary.