Make your own Sixth Sense Device

How to Make you own sixth sense Device  ?? 
So you want to make your own SixthSense Device. Now what?






SixthSense is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.
  • Hardware
  • Software
  • Links / Resources
  • License Information
 Hardware  
Hardware description of SixthSense.

Components

Camera

The camera is the key input device of the SixthSense system. The camera acts as a digital eye of the system. It basically captures the scene the user is looking at. The video stream captured by the camera is passed to mobile computing device which does the appropriate computer vision computation. The major functions of the camera can be listed as:
  • Captures user’s hand movements and gestures (used in reorganization of user gestures)
  • Captures the scene in front and objects the user is interacting with (used in object reorganization and tracking)
  • Takes a photo of the scene in front when the user performs a ‘framing’ gesture
  • Captures the scene of projected interface (used to correct the alignment, placement and look and feel of the projected interface components)

Projector

The projector is the key output device of the SixthSense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces. The mobile computing device provides the projector with the content to be projected. The projector unit used in prototype runs on a rechargeable battery  The major functions of the projector can be listed as:
  • Projects graphical user interface of the selected application onto surfaces or walls in front
  • Augments the physical objects the user interacting with by projecting just-in-time and related information from the Internet
Suggested Products: You can buy either laser (AAXA, Microvision) or L.E.D (3M MPro110) projectors.

Mirror

The mirror reflects the projection coming out from the projector and thus helps in projecting onto the desired locations on walls or surfaces. The user manually can change the tilt of the mirror to change the location of the projection. For example in application where the user wants the projection to go on the ground instead of the surface in front, he can change the tilt of the mirror to change the projection. Thus, the mirror in the SixthSense helps in overcoming the limitation of the limited projection space of the projector.
Suggested Product: Any 1”X1” first surface mirror

Microphone

The microphone is an optional component of the SixthSense. It is required when using a paper as a computing interface. When the user wants to use a sheet of paper as an interactive surface, he or she clips the microphone to the paper. The microphone attached this way captures the sound signals of user’s touching the paper. This data is passed to computing device for processing. Later, combined with the tracking information about user’s finger, the system is able to identify precise touch events on the paper. Here, the sound signal captured by the microphone provides time information whereas the camera performs tracking. The applications enabled by this technique are explained earlier.

Mobile computing device

The SixthSense system uses a mobile computing device in user’s pocket as the processing device. The software program enabling all the features of the system runs on this computing device. This device can be a mobile phone or a small laptop computer. The camera, the projector and the microphone are connected to this device using wired or wireless connection. The detail of the software program that runs on this device is provided in next section. The mobile computing device is also connected to the Internet via 3G network or wireless connection.
Suggested Product: Any windows computer

Now that you have all these pieces, you need a way to combine them. We recommend using Legostrips to form the base. The projector, camera, and mirror assembly can be directly put onto this base. You can also use Velcro to combine the products.

 Software  
Information on setting up the software for SixthSense.

How to run the Software Component of SixthSense

The prototype system runs on windows platform and majority of the code is written in C++ and C#. We will be uploading newer versions as it is being developed; this will also include a mobile version.
NOTE: We are moving the new code to Git this week. Meanwhile you can download it at the link below.

WUW v0.1 beta

Download

Instructions for running WUW_v0.1

WUW_v0.1 is the beta version of SixthSense code (WUW stands for Wear Ur World, a former name of the project). This version runs on Windows. Make sure you have Visual Studio and Direct X installed. Extract and copy the files from wuw_v0.1.zip to any location on your computer. Open WUW01.sln (which is present in the folder "CODE") then click on F5 to debug it. If you debug it successfully, a black screen appears with a little square box on the right just hover your mouse around it and you will find Option tabs such as Camera, Tokens and Apps.
Camera: you can choose which camera to use and configure the camera settings here. You may need to mirror the camera here using the camera settings. It is also recommended to use fixed/manual white balance and exposure such that the camera image is stable and light independent.
Tokens: This version of code uses colored fingertips as markers. One need 4 different colors in order to run most of the Apps. We recommend to use Red, Yellow, Blue and Green (or colors that are different enough). We have also noticed that the matt colored tape/objects works better as they have less reflective changes. When you click on ‘Add Markers’, the screen starts blinking and after 4-5 secs it stops with a still picture so that you can add those markers on your hand as new markers. You can simply drag-select the colored marker on the screen by mouse cursor. Once you have all four markers (O, P, M, and N) added the software will start tracking the four markers. You can set the thresholds to better the tracking. You can save those markers and can reuse in subsequent executions, or can add new markers every time.
Apps: there are three ways to launch any application. Apps tab can let you choose the apps you want to load and run. One can also load apps from ‘Menu’. ‘Menu’ is triggered using Namaste gesture. Once on Menu screen you can choose the App by hand-click (Hand Click gesture works by moving the O marker and hiding P marker.

Links  
Places to buy the SixthSense components.

Suggested Hardware Components

These are the basic pieces that you should buy. You can choose any brand, and the following list are those items that worked well for us:
  • A mirror assembly
    1. Front faced mirror is best, 1”X1” first surface mirror (this can be purchased from anywhere, i.e. Ebay)
  • Laptop Computer: Any Windows computer (this will act as the mobile computing device)
 Licensing  
License information

a) GPL license version 3.0 – Any distributed project that contains within it or makes reference to any portion of the SixthSense source code has to be released with the source code under the GPL version 3.0 license or later.
You can't use this for commercial propose without taking permission of MIT 

UPDATE : Read Here : How to configure the software and add colour markers in sxith sense device

Comments

Post a Comment

Popular posts from this blog

You Don't Have To Pay To Be Infected

Image
As a general IT consumer having various expensive electronics, you decide to keep them safe from malware and viruses. So, just like everyone else, you decide to look up "the best antivirus" to pay for and be safe. The '90s are gone and you could just be wasting or in simple terms, unnecessarily spending for the "protection". This does not mean there is no need to be worried about the infected and malicious software. They are plenty. For example, September 18, the facts about hackers having piggybacked malware onto one of the widely used tools, that was  designed to optimize system performance on Windows PCs and Android mobile device known as CCleaner —  According to Piriform, around 2.27 million users might have installed the infected version of the CCleaner software, a spokesperson told TechCrunch .  The next thing you know, everybody is rushing out to buy a good (expensive) antivirus. There are various antivirus services that offer genuine tools that can
Read more

Online Learning – Does It Pay Off?

Image
At one point or the other, we have all thought about learning online. The question is, is it worth it?The ease of access to the internet has tremendously increased the scope of online learning. But is it really worth it? Let's take a look at the benefits of online learning for students (especially programmers and developers). FLEXIBILITY AND BALANCE Probably the hardest thing about taking up an online course or learning something new is to find the time to do it. Everyone is engaged in activities relating to their personal lives and other commitments. There is a significant amount of time spent in traveling (especially for students who live far away from their respective institutions), reaching the classroom, sitting and waiting for the lecturer to arrive, and then the hassle to travel back. However, the importance of education and building a future for yourself and your family cannot be ignored. Through online learning, you can balance both of these very important thing
Read more

Artificial Intelligence

Image
Introduction to Artificial Intelligence Defining Artificial Intelligence    The phrase Artificial Intelligence I, which was coined by John McCarthy three decades ago, evades a concise and formal definition to date. One representative definition is pivoted around the comparison of intelligence of computing machines with human beings . Another definition is concerned with the performance of machines which "historically have been judged to lie within the domain of intelligence" . None of these definitions or the like have been universally accepted, perhaps because of their references to the word "intelligence", which at present is an abstract and immeasurable quantity. A better definition of artificial intelligence, therefore, calls for formalization of the term "intelligence". Psychologist and Cognitive theorists are of the opinion that intelligence helps in identifying the right piece of knowledge at the appropriate instances of decision making. The ph
Read more