Open Frameworks + Kinect + Sound | Ben McChesney's Blog While attending FlITC San Francisco I saw Theo Watson talk about his work with the creative coding libraries known as open frameworks. While I didn’t have very much experience in c++ besides a couple of simple test apps to learn openGL, I thought it would be a good experience to learn a language completely different from actionscript. Below is the result that I after a very productive day of tinkering: Kinect Sound Experiment with Open Frameworks from Ben McChesney on Vimeo What is openframeworks? I think the most accurate term I’ve heard to describe it is “processing on crack”. Download + install xCode for mac Download openframeworks FAT 0061 and unzip it my work folder ( though it will work anywhere ) Compile any example project under openframeworksFolder/apps/examples/ to make things easier for yourself and to get developing quickly. Time to start playing with the Kinect. Running it looked like this : "Looking good Tex" Neat! But what’s next? But what’s next?
Kinect 3D gesture recognition based on skeleton movements - What libraries exist Support | Skanect by Manctl Contact You can email us at skanect@occipital.com or get help from the Skanect community, in the skanect google group. Tutorials What sensor drivers should I install? How can I use Structure Sensor and Skanect? Do you support the Kinect for Xbox One (Kinect V2)? Unfortunately, we have chosen not to support the Kinect for Xbox One (Kinect V2), as during our tests, the resulting 3D scans did not meet our standards for quality. You can find a complete list of supported devices on our download page: Bad License Key Error – Why doesn’t my license key work? Please ensure there are no “blank spaces” before or after the email and key when you enter them. If you still receive an error message let us know by emailing us skanect@occipital.com What sensor should I buy? Each sensor has its pro and cons. My Kinect for XBox sensor cannot be detected! What graphics cards are supported? My GPU should be supported, but GPU fusion is disabled, why?
Kinect Tutorial - Hacking 101 Microsoft's Kinect has been out for a few months now and has become a fairly popular accessory for the Xbox 360. Let's face it though, using the Kinect for what it was intended didn't end up being the most exciting part of this new toy. What has become far more interesting is seeing the various hacks developed that makes the device so much more than simply an input mechanism for games. Now it's your turn to do something amazing, and this tutorial will get you started. Above is some example output that our app will produce. 1. openkinect.org is going to be your best friend for this portion of the project. 2. Since our plan with this tutorial is just to display output, we can get away with a basic WPF application, which actually performs surprisingly well. Bundled as part of the libfreenect source are a set of wrappers for various languages. You should now be able to build the solution without any errors. 3. As you read through the code, it should be very self-explanatory. Source Files:
FaceCube: Copy Real Life with a Kinect and 3D Printer by nrp The process is currently multi-step, but I hope to have it down to one button press in the future. First, run facecube.py, which brings up a psychedelic preview image showing the closest 10 cm of stuff to the Kinect. Use the up and down arrow keys to adjust that distance threshold. You can then open the PLY file in MeshLab to turn it into a solid STL. You can then open the STL in OpenSCAD or Blender and scale it and modify to your heart’s (or printer’s) content. Since all of the cool kids are apparently doing it, I’ve put this stuff into a GitHub repository. git clone git@github.com:nrpatel/FaceCube.git
Introduction to OpenKinect and as3Kinect This article functions as an introduction to building OpenKinect and as3kinect projects. This is the first in a series of articles on this topic. This opening article attempts to answer the following seven questions:What is Kinect, and what can it do?When and how did OpenKinect get started?What is libfreenect?How do you connect the Kinect to ActionScript? What is Kinect, and What Can It Do? A Kinect is a hardware device that has two cameras. In addition, the Kinect has an array of built-in microphones that can be used to capture voice input, and a motor, that tilts the device up and down, so it can capture motion across a wider field of view. When and How Did OpenKinect Get Started? It was November 10, 2010 when Microsoft released the Kinect in Europe. A few hours after that, the libfreenect project was born, headed by Joshua Blake, and maintained by Hector Martin and Kyle Machulis. What Is libfreenect? Here is a high-level overview diagram that shows how libfreenect works: About the Author
Shaking some sense into using multiple Kinect's with Shake 'n' Sense | Coding4Fun Kinect Projects This is one of those weird things that you just wouldn't expect until you see it... Shake n Sense Makes Kinects Work Together! Microsoft Research has discovered that shaking Kinects, far from making them fall apart, makes them work together. See it in action in the video.This is one of those ideas that once you have seen it you can't believe you didn't think of it first. Project Information URL: Shake 'n' Sense is a novel yet simple mechanical technique for mitigating the interference when two or more Kinect cameras point at the same part of a physical scene. Reducing Structured Light Interference when Multiple Depth Cameras Overlap ABSTRACTWe present a method for reducing interference between multiple structured light-based depth sensors operating in the same spectrum with rigidly attached projectors and cameras. Project Information URL:
Utiliser le Kinect sur son pc, tuto ! « Reservoir Blogs Voilà quelques temps maintenant que le premier pilote pour utiliser le Kinect sur PC est disponible. Je vous propose ici de voir les différents pilotes qui existent, après quoi nous passerons à l’installation de l’un d’entre eux. L’histoire du kinect sur pc remonte à quelques jours après la sortie de l’outil. Hector, the winner Par la suite, ce driver (dont vous trouverez une installation facile pour ubuntu sur la doc ubuntu-fr) est utilisé par une multitude de développeur donnant chacun libre cours à leur imagination (exemples ici ). La société PrimeSense, à l’origine du développement d’une partie du kinect, a quant à elle fournit un autre driver, visant à être utiliser avec ses softwares (OpenNI), et c’est celui que nous allons installer (sur windows, car mon but était de l’utiliser pour jouer et que je n’ai pas de jeux 3d sur ma distribution). Commencez par télécharger et installer: - OpenNI Unstable Build for Windows v1.0.0.25 - PrimeSense NITE Unstable Build for Windows v1.3.0.18 et
FaceCube: Copy Real Life with a Kinect and 3D Printer This project is a tangent off of something cool I’ve been hacking on in small pieces over the last few months. I probably would not have gone down this tangent had it not been for the recent publication of Fabricate Yourself. Nothing irks inspires me more than when someone does something cool and then releases only a description and pictures of it. Thus, I’ve written FaceCube, my own open source take on automatic creation of solid models of real life objects using the libfreenect python wrapper, pygame, NumPy, MeshLab, and OpenSCAD. The process is currently multi-step, but I hope to have it down to one button press in the future. First, run facecube.py, which brings up a psychedelic preview image showing the closest 10 cm of stuff to the Kinect. You can then open the PLY file in MeshLab to turn it into a solid STL. You can then open the STL in OpenSCAD or Blender and scale it and modify to your heart’s (or printer’s) content. Related Posts
Install Kinect on your PC and start developing your programs Install Kinect on your PC and Start developing your Programs: Disclaimer: This comprehensive guide to install Kinect drivers and programs in your PC was made by Software Developer Vangos Pterneas, a student of the Athens University of Economics and Business, Department of Informatics. This guide and any associated source codes and files is licensed under The Code Project website and also under the Code Project Open License. We wish to share this article to educate the Kinect community on how to install the Kinect to their Personal Computers. Introduction Playing Kinect games is a really great experience. Fortunately, PrimeSense, the company behind Kinect, released OpenNI framework and NITE middleware. OpenNI and NITE installation can be painful if not done properly. Step 0 Uninstall any previews drivers, such as CLNUI. Step 1 Drivers are now installed in your PC. Step 2 Download and install the latest stable or unstable OpenNI Binaries from OpenNI website. Step 3 Step 4 Step 5 Step 6 Step 7 Step 8
www.cs.unc.edu/~fuchs/kinect_VR_2012.pdf Nicolas Burrus Homepage - Kinect Calibration Calibrating the depth and color camera Here is a preliminary semi-automatic way to calibrate the Kinect depth sensor and the rgb output to enable a mapping between them. You can see some results there: It is basically a standard stereo calibration technique ( the main difficulty comes from the depth image that cannot detect patterns on a flat surface. Thus, the pattern has to be created using depth difference. Here I used a rectangular peace of carton cut around a chessboard printed on an A3 sheet of paper. Calibration of the color camera intrinsics The color camera intrinsics can be calibrated using standard chessboard recognition. Calibration of the depth camera intrinsics This is done by extracting the corners of the chessboard on the depth image and storing them. Transformation of raw depth values into meters Raw depth values are integer between 0 and 2047. Stereo calibration Color Depth
How Motion Detection Works in Xbox Kinect | Gadget Lab The prototype for Microsoft’s Kinect camera and microphone famously cost $30,000. At midnight Thursday morning, you’ll be able to buy it for $150 as an Xbox 360 peripheral. Microsoft is projecting that it will sell 5 million units between now and Christmas. We’ll have more details and a review of the system soon, but for now it’s worth taking some time to think about how it all works. Kinect’s camera is powered by both hardware and software. And it does two things: generate a three-dimensional (moving) image of the objects in its field of view, and recognize (moving) human beings among those objects. Older software programs used differences in color and texture to distinguish objects from their backgrounds. Time-of-flight works like sonar: If you know how long the light takes to return, you know how far away an object is. Using an infrared generator also partially solves the problem of ambient light. PrimeSense and Kinect go one step further and encode information in the near-IR light.
From Kinect to MakerBot Make: Projects The Open Kinect movement has given us some amazing tools to capture the physical world. With some open source software, a few simple steps, and an occasional not-so-simple-step here and there, you can print what your Kinect can see. You’ve got a Kinect, and you’ve got a MakerBot. It’s very easy to scan something with the Kinect, but the models that you get from it are quite complex. At the moment, these instructions are tested on the Mac.