Open Frameworks + Kinect + Sound | Ben McChesney's Blog While attending FlITC San Francisco I saw Theo Watson talk about his work with the creative coding libraries known as open frameworks. While I didn’t have very much experience in c++ besides a couple of simple test apps to learn openGL, I thought it would be a good experience to learn a language completely different from actionscript. Below is the result that I after a very productive day of tinkering: Kinect Sound Experiment with Open Frameworks from Ben McChesney on Vimeo What is openframeworks? I think the most accurate term I’ve heard to describe it is “processing on crack”. Download + install xCode for mac Download openframeworks FAT 0061 and unzip it my work folder ( though it will work anywhere ) Compile any example project under openframeworksFolder/apps/examples/ to make things easier for yourself and to get developing quickly. Time to start playing with the Kinect. Running it looked like this : "Looking good Tex" Neat! But what’s next? But what’s next?
Install FAAST on your PC Install FAAST on your PC for full body control and VR applications: Disclaimer: This comprehensive guide of FAAST installation was taken from Institute for Creative Technologies website. The toolkit of the FAAST was also taken from the same site. By sharing their guide to the community, Kinecthacks.com wishes to promote the value of innovation and creativity with the Micrsoft’s Kinect. Summary FAAST is middleware to facilitate integration of full-body control with games and VR applications. FAAST is free to use and distribute for research and noncommercial purposes (for commercial uses, please contact us). The preliminary version of FAAST is currently available for Windows only. Installation To use FAAST, you will need to download and install the following software: FAAST should then run out-of-the-box; no additional installation or setup is necessary. Skeleton Usage Currently, FAAST streams the entire skeleton for the first calibrated user that is currently visible to the sensor.
HOWTO: Kinect + OpenNI/NITE skeleton tracking and gesture recognition in gentoo Thanks to the folks at PrimeSense libraries are now available for skeleton tracking and gesture recognition. UPDATE: Check here if you've gotten NITE working and want to try using the kinect as a Minority Report style mouse.UPDATE:I've added a description of how to track multiple hands under the Sample-PointViewer description. Here's how I got things working in gentoo: (15)Repeat step 14 for Sample-Scene.xml and Sample-Tracking.xml(16)Open Sample-User.xml and replace the existing MapOutputMode line with the line below. NOTE: this is case sensitive! (17)Repeat step 16 for Sample-Scene.xml and Sample-Tracking.xml(18)niLicense PrimeSense 0KOIk2JeIBYClPWVnMoRKn5cdY4=(19)cd ~/kinect/NITE/Nite-1.3.0.17/(20)sudo . Now finally you should be sitting in a directory with all the sample binaries that you can play with. Sample-TrackPad:This app will track your hand and show it's relative position on a grid. you should also get some debug output in your console:
Connect Kinect to PC Using PrimeSense Drivers - OpenKinect | Grups de Google Hi I was confused with different instructions for connecting Kinect to PC. Actually I couldn't install OpenKinect drivers, but I come up with an instruction 4 Dummies! I would be glad if somebody makes something like this for OpenKinect. Sajjad Step 1 Uninstall any previews drivers, such as CLNUI, OpenKinect,.... Uninstalling a driver does not seem to be easy esp in case of OpenKinect Step 2 Download and install the latest stable or unstable OpenNI Binaries from OpenNI website. There might be a security check message in this step and the next one. Step 3 Download Kinect Driver from the following link. Unzip the file and run avin2-SensorKinect-0124bd2\Bin\SensorKinect-Win32-5.0.0.exe Step 4 Restart Step 5 Plug in Kinect. Currently no driver for Audio available by Primesense, although there is one provided by OpenKinect. Step6 Check OpenNI samples. Step 7 Download and install the latest stable or unstable OpenNI Compliant Middleware Binaries (NITE) from OpenNI website. Step 8 Restart. Step 9 Step 10
Kinect Tutorial - Hacking 101 Microsoft's Kinect has been out for a few months now and has become a fairly popular accessory for the Xbox 360. Let's face it though, using the Kinect for what it was intended didn't end up being the most exciting part of this new toy. What has become far more interesting is seeing the various hacks developed that makes the device so much more than simply an input mechanism for games. Now it's your turn to do something amazing, and this tutorial will get you started. Above is some example output that our app will produce. 1. openkinect.org is going to be your best friend for this portion of the project. 2. Since our plan with this tutorial is just to display output, we can get away with a basic WPF application, which actually performs surprisingly well. Bundled as part of the libfreenect source are a set of wrappers for various languages. You should now be able to build the solution without any errors. 3. As you read through the code, it should be very self-explanatory. Source Files:
FaceCube: Copy Real Life with a Kinect and 3D Printer by nrp The process is currently multi-step, but I hope to have it down to one button press in the future. First, run facecube.py, which brings up a psychedelic preview image showing the closest 10 cm of stuff to the Kinect. Use the up and down arrow keys to adjust that distance threshold. You can then open the PLY file in MeshLab to turn it into a solid STL. You can then open the STL in OpenSCAD or Blender and scale it and modify to your heart’s (or printer’s) content. Since all of the cool kids are apparently doing it, I’ve put this stuff into a GitHub repository. git clone git@github.com:nrpatel/FaceCube.git
Flexible Action and Articulated Skeleton Toolkit (FAAST) Contributors Evan A. Suma, Belinda Lange, Skip Rizzo, David Krum, and Mark Bolas Project Email Address: faast@ict.usc.edu 32-bit(recommended for most users) 64-bit(for advanced users) Note from Evan Suma, the developer of FAAST: I have recently transitioned to a faculty position at USC, and unfortunately that means I have very limited time for further development of the toolkit. You may also view our online video gallery, which contains videos that demonstrate FAAST’s capabilities, as well as interesting applications that use the toolkit. Have a Kinect for Windows v2? We have developed an experimental version of FAAST with support for the Kinect for Windows v2, available for download here (64-bit only). Recent News December 12, 2013 FAAST 1.2 has been released, adding compatibility for Windows 8. Summary FAAST is middleware to facilitate integration of full-body control with games and VR applications using either OpenNI or the Microsoft Kinect for Windows skeleton tracking software. E. Support
OpenNI to Max/MSP via OSC – tohm judson OpenNI is a “natural interaction” software that uses the Kinect for XBox 360. Using this, connected to a Mac, we can control various software via OSC. Here, I will show you how to get the data into Max. The idea here is that you are like me, longing to try, but missing the few crucial steps that the README’s forget about the amateur hacker. Preliminaries: First, if you are not comfortable with the terminal, I will try to walk you through it. Second, I have tried this on three machines just to be safe that I did not ruin anything. UPDATE: you need to be on OS 10.6 for this to work from what I can tell Third… I cannot help you. A Brief Terminal Primer (all you will need to know; no more, no less) Where is it? Applications> Utilities> Terminal What to do with it for now? Add it to your Dock if you don’t have it there… trust me on this one… you will use it a lot What code will I need to know? sudo= superuser… makes things happen. cd= change directory Install XcodeInstall CMakeInstall MacPorts OpenNI:
C++ GL Example main.cpp Makefile This Makefile is probably not Portable to your System then are changes required CC = g++ LD = g++ LDFLAGS = CFLAGS=-g -Wall `pkg-config --cflags libfreenect` -lopengl32 -lglut32 LIBS = `pkg-config --libs libfreenect` -lGL -lGLU -lglut OBJECTS = main.o PROG = mycppview all:$(PROG) $(PROG): $(OBJECTS) $(LD) $(LDFLAGS) $(LIBS) $(OBJECTS) -o $(PROG) %.o: %.cpp $(CC) $(CFLAGS) $(LIBS) -c $< clean: rm -rf *.o $(PROG) Utiliser le Kinect sur son pc, tuto ! « Reservoir Blogs Voilà quelques temps maintenant que le premier pilote pour utiliser le Kinect sur PC est disponible. Je vous propose ici de voir les différents pilotes qui existent, après quoi nous passerons à l’installation de l’un d’entre eux. L’histoire du kinect sur pc remonte à quelques jours après la sortie de l’outil. Hector, the winner Par la suite, ce driver (dont vous trouverez une installation facile pour ubuntu sur la doc ubuntu-fr) est utilisé par une multitude de développeur donnant chacun libre cours à leur imagination (exemples ici ). La société PrimeSense, à l’origine du développement d’une partie du kinect, a quant à elle fournit un autre driver, visant à être utiliser avec ses softwares (OpenNI), et c’est celui que nous allons installer (sur windows, car mon but était de l’utiliser pour jouer et que je n’ai pas de jeux 3d sur ma distribution). Commencez par télécharger et installer: - OpenNI Unstable Build for Windows v1.0.0.25 - PrimeSense NITE Unstable Build for Windows v1.3.0.18 et
FaceCube: Copy Real Life with a Kinect and 3D Printer This project is a tangent off of something cool I’ve been hacking on in small pieces over the last few months. I probably would not have gone down this tangent had it not been for the recent publication of Fabricate Yourself. Nothing irks inspires me more than when someone does something cool and then releases only a description and pictures of it. Thus, I’ve written FaceCube, my own open source take on automatic creation of solid models of real life objects using the libfreenect python wrapper, pygame, NumPy, MeshLab, and OpenSCAD. The process is currently multi-step, but I hope to have it down to one button press in the future. First, run facecube.py, which brings up a psychedelic preview image showing the closest 10 cm of stuff to the Kinect. You can then open the PLY file in MeshLab to turn it into a solid STL. You can then open the STL in OpenSCAD or Blender and scale it and modify to your heart’s (or printer’s) content. Related Posts
Kinect Open Source Programming Secrets Kinect Open Source Programming Secrets (KOPS) is the only book that explains the official Java wrappers for OpenNI and NITE. (If you want installation instructions, scroll down this page a little.) The main drawback of using the PrimeSense Java wrappers is their lack of documentation. As I explain in chapter 1, I had to decompile the libraries' JAR files, and work out the correspondences between the Java source and the somewhat better documented C++ OpenNI/NITE APIs. This book covers programming topics not found elsewhere. Early (sometimes very early) draft versions of KOPS's chapters can be downloaded from here (see the links below). If you're looking for Killer Game Programming in Java then it's here. What this Book is Not About I'm concentrating on the Kinect without including chapters explaining OOP concepts such as classes, objects, and inheritance. More importantly, I don't have the space to seriously explain the topics of 3D graphics or computer vision. Dr.
Kinect for Windows SDK Quickstarts 8 minutes, 56 seconds 6 minutes, 50 seconds 12 minutes, 16 seconds 15 minutes, 36 seconds 16 minutes, 57 seconds 11 minutes, 48 seconds Main Page