Scribd Logo
Upload

Welcome to Scribd!

  • Hardware - Sixth Sense - Hardware Description of Sixth Sense. - An Open Source Project That Allows People To Create Their Own Sixth Sense Device

    Uploaded by

    Gtops Diponeng
    327 views9 pages
    Sixthsense is An open source project that allows people to create their own SixthSense Device and augment the current codebase with their own apps. Camera acts as a digital eye of the system. It basically captures the scene the user is looking at. Projector is the key output device of the sixthsense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces.

    Original Description:

    Original Title

    Hardware - Sixth Sense - Hardware Description of Sixth Sense. - An Open Source Project That Allows People to Create Their Own Sixth Sense Device

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    Sixthsense is An open source project that allows people to create their own SixthSense Device and augment the current codebase with their own apps. Camera acts as a digital eye of the system. It basically captures the scene the user is looking at. Projector is the key output device of the sixthsense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    327 views9 pages

    Hardware - Sixth Sense - Hardware Description of Sixth Sense. - An Open Source Project That Allows People To Create Their Own Sixth Sense Device

    Uploaded by

    Gtops Diponeng
    Sixthsense is An open source project that allows people to create their own SixthSense Device and augment the current codebase with their own apps. Camera acts as a digital eye of the system. It basically captures the scene the user is looking at. Projector is the key output device of the sixthsense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 9

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    My favorites | Sign in

    sixthsense
    An open source project that allows people to create their own SixthSense Device and augment the current codebase with their own apps. Project Home Search Downloads for Wiki Search Search projects

    Hardware
    Hardware description of SixthSense.
    Updated Jan 6, 2012 by pranavmi...@gmail.com

    Create your own SixthSense Device


    So you want to make your own SixthSense Device. Now what?

    Components
    Camera
    The camera is the key input device of the SixthSense system. The camera acts as a digital eye of the system. It basically captures the scene the user is looking at. The video stream captured by the camera is passed to mobile computing device which does the appropriate computer vision computation. The major functions of the camera can be listed as: Captures users hand movements and gestures (used in reorganization of user gestures) Captures the scene in front and objects the user is interacting with (used in object reorganization and tracking) Takes a photo of the scene in front when the user performs a framing gesture Captures the scene of projected interface (used to correct the alignment, placement and look and feel of the projected interface components) Suggested Product: Logitech QuickCam Pro for notebooks

    Projector
    The projector is the key output device of the SixthSense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces. The mobile computing device provides the projector with the content to be projected. The projector unit used in prototype runs on a rechargeable battery. The major functions of the projector can be listed as: Projects graphical user interface of the selected application onto surfaces or walls in front Augments the physical objects the user interacting with by projecting just-in-time and related information from the Internet Suggested Products: You can buy either laser (AAXA, Microvision) or L.E.D (3M MPro110) projectors.

    Mirror
    The mirror reflects the projection coming out from the projector and thus helps in projecting onto the desired locations on walls or surfaces. The user manually can change the tilt of the mirror to change the location of the projection. For example in application where the user wants the projection to go on the ground instead of the surface in front, he can change the tilt of the mirror to change the projection. Thus, the mirror in the SixthSense helps in overcoming the limitation of the limited projection space of the projector. Suggested Product: Any 1X1 first surface mirror

    Microphone
    The microphone is an optional component of the SixthSense. It is required when using a paper as a computing interface. When the user wants to use a sheet of paper as an interactive surface, he or she clips the microphone to the paper. The microphone attached this way captures the sound signals of users touching the paper. This data is passed to computing device for processing. Later, combined with the tracking information about users finger, the system is able to identify precise touch events on the paper. Here, the sound signal captured by the microphone provides time information whereas the camera performs tracking. The applications enabled by this technique are explained earlier. Suggested Product: Microphone of Logitech QuickCam pro for notebooks

    Mobile computing device


    The SixthSense system uses a mobile computing device in users pocket as the processing device. The software program enabling all the features of the system runs on this computing device. This device can be a mobile phone or a small laptop computer. The camera, the projector and the microphone are connected to this device using wired or wireless connection. The detail of the software program that runs on this device is provided in next section. The mobile computing device is also connected to the Internet via 3G network or wireless connection. Suggested Product: Any Windows computer For a more detailed list of resources, along with prices check Links / Resources

    1 of 9

    31/01/2012 17:53

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    Now that you have all these pieces, you need a way to combine them. We recommend using Lego strips to form the base. The projector, camera, and mirror assembly can be directly put onto this base. You can also use Velcro to combine the products.

    Comment by jaimanda...@gmail.com, Sep 4, 2011 you have described all about the hardware configuration but didn't mention how these devices connected with each other and how it works..? Comment by ole.w...@gmail.com, Sep 5, 2011 The connections seem reasonably obvious to me: the USB camera is plugged into the computer's USB port. The microphone is plugged into the computer's microphone jack; or if it communicates with the computer via USB, it's probably already plugged in together with the USB camera. The projector is plugged into the VGA port and projects downward toward the user's feet. The mirror is placed just below the projector, reflecting the image onto objects in front of the user. This is mostly for convenience so you won't have a long projetor sticking out in front of you. The camera points forward. The rest is a job for the software. Comment by dili007...@gmail.com, Sep 5, 2011 but on what platform it works.....how the code is written??????? Comment by ole.w...@gmail.com, Sep 6, 2011 The text states that the prototype is running on a Microsoft Windows computer. According to the software pages, the code is written in C/C++ and will be available (hopefully) shortly. Comment by casher.k...@yahoo.com, Sep 8, 2011 can you attach some instruction on how to use the hardware and software :P Comment by zfw...@gmail.com, Sep 9, 2011 will you market it? please do ;-) Comment by singhala...@gmail.com, Sep 9, 2011 how does it connects Comment by shababa...@gmail.com, Sep 11, 2011 Hey, im really interested in this device but through these instructions i cant seem to find a clear way to run and connect all the components of the device CAN SOMEONE PLEASE ANSWER BACK WITH SOME THOROUGH ANSWERS TO THIS QUESTION .... ANYONE. Comment by shababa...@gmail.com, Sep 11, 2011 Nevermind ^ i got how to connect it all ... but how do u run it???

    2 of 9

    31/01/2012 17:53

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    Comment by shababa...@gmail.com, Sep 11, 2011 Whats the point of the color markers and then lego strips?? Comment by javiergi...@gmail.com, Sep 11, 2011 Hi there mate, when will the OpenSource? Code be available to download? please let us know, its a very interesting project you got there! congrats and thanks for sharing. Comment by neelesh_...@yahoo.co.in, Sep 12, 2011 i cant understand what those color markers are.......?? what is it made up of.......??? what is its specialty.......??? why do we need to use color markers instead of our fingers.....??? what is the diff if we use our finger or a color marker.....??? please reply soon to my email id : n.neelesh.ganan@gmail.com i am doing a documentation on it in my college. so i need ur response sooooooooonnnnn Comment by aastha.b...@gmail.com, Sep 12, 2011 @shababa...@gmail.com , @ neelesh...@yahoo.co.in : Color markers are at the tip of the users fingers .Marking the users fingers with red, yellow, green, and blue tape helps the webcam recognize gestures. The movements and arrangements of these makers are interpreted into gestures that act as interaction instructions for the projected application interfaces. Comment by nivesree...@gmail.com, Sep 13, 2011 i want a clear concept to make it upon please tel me Comment by devonwal...@gmail.com, Sep 13, 2011 It would also help u could make video on YouTube? on step be step instructions on how to make it. Comment by pranava2...@gmail.com, Sep 18, 2011 From where should the software be downloaded for this???? Plz reply as soon as possible cuz i've already made that thing but just want to know what to do next??? Tnx in advance Comment by geoff.ro...@gmail.com, Sep 20, 2011 HOW TO RUN THIS First, you'll need to understand C++. Get a book and learn some C++ and get a few basic programs running. Then you'll have a good idea how to put the software together with the hardware. It's open source, not an 49p "App". Comment by cspure...@hotmail.com, Sep 27, 2011 Yes the only way to get this to work is if you have knowledge of c++ or c# (you well need to fully understand the programming languages) Comment by mssoltan...@gmail.com, Oct 4, 2011 is there a step by step tutorial on how to make it. Dude I'll pay for it if its a dvd. if its youtube its better. Comment by parate.a...@gmail.com, Oct 7, 2011 Does we need to use windows mobile phone compulsory? or any mobile phone is sufficiant? please specify.thank you. Comment by niteshim...@gmail.com, Oct 8, 2011 i want to know that it is important to buy hardware from only these links . but not from other source, company or other market, which will be more economical and easy. rather than that thing pls tell us the configuration of these hardwares..pls tell me i m dieing to make this project. Comment by gauravgu...@gmail.com, Oct 9, 2011 tell me,how can a camera scan our motion... Comment by shankeyr...@gmail.com, Oct 10, 2011

    3 of 9

    31/01/2012 17:53

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    hey can you plz just let me know one thing...what have you used as a MOBILE COMPUTING DEVICE??? a laptop?? bt where should we keep it while using the SIXTH SENSE??? and how are we going to manage with the bulkness, battery and other issues of the laptop?? please reply Comment by Anders.n...@hotmail.com, Oct 10, 2011 Truly remarkabel project you have going on here. Congratulation. I will start to learn C++ asap now :-) Thanks for this opportunity and inspiring technology. Hope to see more from you. Comment by kamblepr...@gmail.com, Oct 13, 2011 Thanx Comment by eikymin...@gmail.com, Oct 16, 2011 Can somebody please post the steps or video on "How to connect all required hardware components ?" please!. Comment by a...@adambreen.com, Oct 24, 2011 Hey people, watch this video from Ted Talks on Sixth Sense. It should answer a few of your questions. http://www.ted.com/talks/lang/eng /pranav_mistry_the_thrilling_potential_of_sixthsense_technology.html Comment by microsof...@gmail.com, Oct 24, 2011 I have been looking into cheap, portable Windows 7 tablet machines, I found a few on EBay that seem to have the power and the USB. This one is only 330 + shipping. http://www.ebay.com/itm/New-9-7-Windows-7-Intel-N455-1-66GHz-2GB-32GB-WIFI-Camera-Laptop-TabletPC-N97-/260871930722?pt=US_Tablets&hash=item3cbd2dc362 Comment by knightso...@gmail.com, Nov 3, 2011 What are the minimum hardware specifications to get this to run? Does it use any windows specific libraries, or could it be reconfigured to run on linux? Comment by boddulah...@gmail.com, Nov 7, 2011 great invention. how to download it? Comment by boddulah...@gmail.com, Nov 7, 2011 thanks for such an invention. Comment by ramaling...@gmail.com, Nov 7, 2011 Hi Pranav.......... Your Product is very amazing ya....i really proud of u...Thanks and ALL THE BEST TO NEW THINGS Comment by soumya.p...@gmail.com, Nov 10, 2011 This product is a creation !! Pranav, could you please let us know how to connect these devices to each other. Thank you !! Warmest Regards, Soumya Prakash Parhi Comment by prakash....@gmail.com, Nov 11, 2011 Hi Pranav, There is one suggestion on the camera & Projector part as far as the hardware is concerned can we use any mobile phones hardware i.e. like their cam & Projector for the project by hacking them by any means like I found 2 cell phones (Spice M-9000 & Intex V.Show Mini Theatre (IN 8809) ) which are compact enough and low cost too. So please suggest how can we use these device for the project as it meets all the hardware requirements suggested by you but how can we use the software code for the same or can we have new set of code for them. Thanks & Regards, Prakash J Chandan Comment by jungt...@gmail.com, Nov 12, 2011

    4 of 9

    31/01/2012 17:53

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    This is it guys Comment by sunilamu...@gmail.com, Nov 13, 2011 Hi Pranav, What would be the total estimated cost of the project Comment by sunilamu...@gmail.com, Nov 13, 2011 sorry, I got the estimated cost... thanks sunil Comment by scjoshi....@gmail.com, Nov 17, 2011 hey now that Aakash tablet has been launched, i feel u should make 6th sense compatible with that Comment by noellach...@gmail.com, Nov 19, 2011 thanks so much for sharing, though i still have no idea how to connect it to the main device and should the device just be the phone or laptop as it is. ^^ Comment by veluvive...@gmail.com, Nov 21, 2011 HI PRANAV, That's a great innovation, you have made the country proud... But, it would be great if you come back to INDIA and guide her into the future, all these years SHE has been generous in giving out great minds to other nations, It's time SHE got some back.... Consider my request please. Comment by zero4...@gmail.com, Nov 23, 2011 there is no sourcecode http://code.google.com/p/sixthsense/source/checkout Comment by anshulwa...@gmail.com, Nov 29, 2011 Hi pranav, your technology is really on everyonez mind.... even on my mind... m working on this in my college... need to submit sixth sense as a project... but really need help for the connection thing... i wish u or ur team members will help me.... id-mukul_wadhwa1011@yahoo.co.in Comment by amitpari...@gmail.com, Dec 2, 2011 Innovation is the key to research ... and you showed it ... I wonder how second life researchers will react to this ... Comment by amitmg...@gmail.com, Dec 2, 2011 hi, how to setup hardware ? Comment by rajat21r...@gmail.com, Dec 5, 2011 Where can you buy this whole set Comment by rajat21r...@gmail.com, Dec 5, 2011

    5 of 9

    31/01/2012 17:53

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    Just assemble all this stuff and sell it Comment by rajat21r...@gmail.com, Dec 5, 2011 Just assemble all this stuff and sell it Comment by VictorMe...@gmail.com, Dec 10, 2011 good stuff. Comment by damianhi...@gmail.com, Dec 13, 2011 the kinect cammra on the xbox 360 is just what this projet needs its way better at tracking stuff, like your fingers so you dont have to wear those caps on your fingers hears a short vid of what i am talking about. http://youtu.be/-yxRTn3fj1g Comment by nathanan...@yahoo.com, Dec 16, 2011 Meanwhile, please buy ALL the devices from Amazon (I guess he's not an affiliate) Comment by ankitdak...@gmail.com, Dec 22, 2011 hatzz off 2 u pranav sir....i wud like to c it get implemented n assesibl to d physically disabld ppl of this world..gr8 job sir...i am lukin forwrd 4 dis open source sharin 2 build one for myself too.. Comment by PrasMai...@gmail.com, Dec 24, 2011 My Suggesstion: If this has been completely done using Free Open source softwares and programming lanugages like c / C++ / python etc. there is no software cost involved... when this project is let open source.. then why not it should be done using open source tools. because Linux users like me would not use dll files or microsoft visual studio to achieve this. If i could know under what license this has been released, Me and my team would port this technology completely using open source technologies and generic language which supports every operating system and not proprietary like C#.Thanks for letting the codes Open source. Comment by dmaly...@gmail.com, Dec 24, 2011 software up for download fellow enthusiasts....hope we make it right... Comment by gary.wan...@gmail.com, Dec 25, 2011 have no idea,want to own one of myself. Comment by everes...@gmail.com, Dec 26, 2011 I am trying to connect via my ipod touch, but I can only view videos? I am using composite cables from my ipod to a P1 Jr aaxa projector. How do I get it to mirror safari, etc? Thanks. Everest Comment by praveenk...@gmail.com, Dec 26, 2011 Pranav, This is a great invention, probably among top 5 in history. Congratulations on that and thanks for making it open source. Comment by saga...@gmail.com, Dec 28, 2011 Copying a zip file and putting out does not make your code 'open source'. Open source is all about community. Why can't can't "develop" the code in "open" ? Why don't you use the source control? Why c# was chosen? Comment by project member pranavmi...@gmail.com, Dec 28, 2011 @Sagarun Thanks for your comment. Yes, we agree. All these is coming. We are working on it. Want to help in it? Comment by casher.k...@yahoo.com, Dec 28, 2011

    6 of 9

    31/01/2012 17:53

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    what to do to help? i wann use it for my new mobile htc :) and can you describe or add some more examples of projectors and mirror holders and webcams, cause i think this should work with almost every hardware thats based on windows (C,C++,C#) or can connect to these devices :P Comment by coolrk...@gmail.com, Dec 30, 2011 @Pranav : Hey bro you did a tremendous job n thanks for sharing the software. I am able to run the apps successfully. But can it do the paper editing stuffs that you did using microphone and AR technology ...? Comment by annu1...@gmail.com, Dec 31, 2011 @coolrk : can you please tell us how to configure the software? Comment by coolrk...@gmail.com, Dec 31, 2011 @annu1: 1.First of all you need Visual Studios and direct x installed.... (I am using Visual studios ultimate 2010)... 2.Then u need to copy the files from wuw_v0.1.zip to any location on your computer. 3.Click on WUW01.sln (which is present in the folder "CODE") then click on F5 to debug it. 4.If you debug it successfully...a black screen appears with a little square box on the right just hover your mouse around it and you will find some options like Camera,Tokens,Apps...(Internet connection is required ) 5.Click on Tokens,(This is where you need to add your markers) 6.Then click on new marker,you will find that the screen starts blinking and after 4 secs it stops with a still picture.Now add the colour markers.(You need Four markers) 7.After adding,square boxes appears to move on your four colour markers ,then save those four markers. 8.And now test different apps like draw,Jeff Han,etc Comment by project member pranavmi...@gmail.com, Dec 31, 2011 @coolrk.15 Thanks. We will upload the instructions and new versions that support those features soon. Comment by khayyam....@gmail.com, Dec 31, 2011 How did you remove the mic from the camera? Comment by coolrk...@gmail.com, Dec 31, 2011 @Pranav : Ok... thanks again and Happy new year 2012. Comment by sasibind...@gmail.com, Jan 1, 2012 all indians are proud of you sir.our english mam in our college has shown your video and inspired us. please aceept our wishe to you from 'SHRI VISHNU ENGINERING COLLEGE FOR WOMEN'.wish u a happy new year 2012.we have assistive technology lab in our college to help the disable.we want to make your project at basic level in our college.the basic level means "by using four sensors of mouse u made the device which can wear to our hand",that we want to make simply.can u please provide any information about this?(because in video we are unable to understand) thank you Comment by payam.1...@gmail.com, Jan 1, 2012 no need to do so much of visual basic debugging etc...... just go to the property of "\code\WUW01\bin\Debug\WUW01.exe" and change the compatibility to windows 98 and it will run fine without visual basic and all the long-cut process Comment by khalid.m...@gmail.com, Jan 2, 2012 would it be possible for some one to make a video or a sheet with the complete directions on how to make this device? thank you to anyone who does Comment by coolrk...@gmail.com, Jan 2, 2012 @payam :oh ya it works .Are you able to run the apps like the Newspaper,Mail and Menu ?? I am facing problems with those apps...

    7 of 9

    31/01/2012 17:53

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    Comment by coolrk...@gmail.com, Jan 3, 2012 @khalid: I have made the tutorial Go to http://sixthsensewuw.blogspot.com/2012/01/how-to-configure-software-and-add.html Hope it helps Comment by charlesa...@gmail.com, Jan 4, 2012 Thanks Pranav for the Code. Wish you a Happy & Prosperous New Year. I did manage to test it under OS Windows 7 Profession 32bit but it keeps crashing when I try to test it under Windows 7 64bit. Any suggestions are high appreciated. Thanks once again and keep it up. Well Done!!! Comment by casher.k...@yahoo.com, Jan 4, 2012 @charles: on Windows 7 64bit u have to solve the problem like me or marconi on the Software page here :D Comment by ankit.me...@gmail.com, Jan 4, 2012 Can anybody make tut for assembling hardware ? Comment by ddandmml...@gmail.com, Jan 5, 2012 very ... good! Comment by 2010yang...@gmail.com, Jan 9, 2012 very good! Comment by Cuno...@gmail.com, Jan 9, 2012 Pranav, This is most incredible project I've seen. I've just finished my advanced course in C++ so it's pretty exciting for me to find out a lot of it is written in C++/C#. I sincerely hope this continues to grow. I'll be looking into building my own and contributing soon. Comment by akashmc...@gmail.com, Jan 12, 2012 Hi, am akash from cochin, india. am working on beagle board for my BTech. project. can we cross compile this code and make it run in an arm platform. can we run it in linux ( angstome) hoping to get a reply :) Comment by casher.k...@yahoo.com, Jan 13, 2012 hey, if u wanna earn money like google or facebook without any cost, click here: http://signup.wazzub.info/?lrRef=iiq4W its easy, only refer other people, e.g. your family members or friends. its totally free, but in beta phase now.. have fun and earn referrals/money waiting for the final release of sixthsense project ;) Comment by techno...@gmail.com, Jan 16, 2012 @akash : m also developing under BeagleBone? with android OS Comment by satyam4...@gmail.com, Jan 18, 2012 hi friends, i have seen New Nikon Coolpix S1200pj Projector Digital Camera + Accessories, on ebay which is very much similar/cost effective for hardware required for us...................please see product and specification..................please tell me will it work as sixth sense device. http://www.ebay.in/itm/New-Nikon-Coolpix-S1200pj-Projector-Digital-Camera-Accessories-/230732659762?pt=LH_DefaultDomain_203& hash=item35b8bcfc32 Thanks and reply soon

    8 of 9

    31/01/2012 17:53

    Hardware - sixthsense - Hardware description of SixthSense. - An open...

    http://code.google.com/p/sixthsense/wiki/Hardware

    Comment by patelhar...@gmail.com, Jan 20, 2012 hi, I am Harsh Patel and I am a High School Student at James B. Conant High School at Hoffmen Estates Il, and I don't have a lot of Exprience with C++, i was wondering if you had a biggner invention I can use to get fimiliar with this amazing technology. Comment by vikas.de...@gmail.com, Jan 21, 2012 Is there a small Sixth Sense device --> just a Camera + earphones + system == Expected to click picture of the person, scan the photo thru the database and "say" or 'speakout' the name of the person and optionally other details of the person? There are Android mobile apps for same. However, picture taking may not be liked by many. When the picture is taken using Sixth Sense device, the person will not know about it. Comment by renittoj...@gmail.com, Jan 27 (4 days ago) is there any problem in using colour markers which have the same colour of the background ? will it distinguish the marker from the background ? and what type image processing is used ? Comment by casher.k...@yahoo.com, Jan 28 (3 days ago) @renittoj: I had the same problem..the camera recognizes all things that have the same colour of the colour markers. the software is not develoved that based yet.. we have to wait..may he find other solutions :D Comment by taylorwh...@gmail.com, Jan 28 (2 days ago) I am having a problem getting the debugger to recognize directx the error message says Error 2 The type or namespace name 'DirectX' does not exist in the namespace 'Microsoft' (are you missing an assembly reference?) C:\code\WUW01\WUW.cs 42 17 WUW01 I have run a diognostic and yes I do have directx 11 can anybody help????

    Sign in to add a comment

    2011 Google - Terms - Privacy - Project Hosting Help Powered by Google Project Hosting

    9 of 9

    31/01/2012 17:53

    You might also like