background preloader

3D Video Capture with Kinect

Open Frameworks + Kinect + Sound | Ben McChesney's Blog While attending FlITC San Francisco I saw Theo Watson talk about his work with the creative coding libraries known as open frameworks. While I didn’t have very much experience in c++ besides a couple of simple test apps to learn openGL, I thought it would be a good experience to learn a language completely different from actionscript. Below is the result that I after a very productive day of tinkering: Kinect Sound Experiment with Open Frameworks from Ben McChesney on Vimeo What is openframeworks? I think the most accurate term I’ve heard to describe it is “processing on crack”. Download + install xCode for mac Download openframeworks FAT 0061 and unzip it my work folder ( though it will work anywhere ) Compile any example project under openframeworksFolder/apps/examples/ to make things easier for yourself and to get developing quickly. Time to start playing with the Kinect. Running it looked like this : "Looking good Tex" Neat! But what’s next? But what’s next?

Sistema Kinect, que usa corpo como joystick, chega ao Brasil por R$ 600 O Kinect é um dos maiores lançamentos da Microsoft em 2010. O acessório que capta os movimentos dos jogadores e os transfere para dentro dos games, sem a necessidade de joystick, conhecido anteriormente por Project Natal, chega às lojas do Brasil no dia 18 de novembro pelo preço de R$ 600. “Acredito que atrairemos novos jogadores que têm aversão ao joystick ou que querem atrair a namorada ao games”, afirma Guilherme Camargo, gerente de marketing para Xbox 360 da Microsoft Brasil. O aparelho possui um conjunto de câmeras que consegue mapear o jogador e o ambiente em que ele está. Kinect é o acessório que capta os movimentos dos jogadores e dispensa o joystick. “O menu é interativo e totalmente em português”, conta Camargo “Existe um tutorial do próprio acessório que configura o Kinect automaticamente. O jogo “Kinect Adventures” acompanha o acessório. Cena de 'Corredeira', modalidade presente no game 'Kinect Adventures', que acompanha o Kinect.

FaceCube: Copy Real Life with a Kinect and 3D Printer by nrp The process is currently multi-step, but I hope to have it down to one button press in the future. First, run facecube.py, which brings up a psychedelic preview image showing the closest 10 cm of stuff to the Kinect. Use the up and down arrow keys to adjust that distance threshold. Pressing spacebar toggles pausing capture, to make it easier to pick objects. Click on an object in the preview to segment it out. Everything else will disappear; clicking elsewhere will clear the choice. You can then open the PLY file in MeshLab to turn it into a solid STL. You can then open the STL in OpenSCAD or Blender and scale it and modify to your heart’s (or printer’s) content. Since all of the cool kids are apparently doing it, I’ve put this stuff into a GitHub repository. git clone git@github.com:nrpatel/FaceCube.git

Patente indica que Kinect poderá reconhecer linguagem dos sinais Uma patente da Microsoft indica que o Kinect poderá reconhecer a linguagem dos sinais, permitindo que pessoas com deficiência possam enviar comandos para o aparelho com simples gestos. A patente ainda informa que o acessório do console Xbox 360 que captura os movimentos do jogador e leva para dentro dos games, dispensando o uso do joystick, consegue ler lábios e identificar movimentos dos dedos das mãos e dos pés. Nenhuma destas funcionalidades do Kinect, anteriormente conhecido como Project Natal, foram apresentadas pela Microsoft até o momento. A patente ainda informa que, durante um bate-papo, a pessoa pode se comunicar por meio da linguagem dos sinais e a pessoa do outro lado receberá o que está sendo dito em forma de áudio. Kinect (Foto: Divulgação) A Microsoft não confirmou a existência destas funções no Kinect, que chegará às lojas norte-americanas no dia 4 de novembro. No Brasil, o Kinect chegará oficialmente até o final do ano e reconhecerá comandos de voz em português.

FaceCube: Copy Real Life with a Kinect and 3D Printer This project is a tangent off of something cool I’ve been hacking on in small pieces over the last few months. I probably would not have gone down this tangent had it not been for the recent publication of Fabricate Yourself. Nothing irks inspires me more than when someone does something cool and then releases only a description and pictures of it. Thus, I’ve written FaceCube, my own open source take on automatic creation of solid models of real life objects using the libfreenect python wrapper, pygame, NumPy, MeshLab, and OpenSCAD. The process is currently multi-step, but I hope to have it down to one button press in the future. You can then open the PLY file in MeshLab to turn it into a solid STL. You can then open the STL in OpenSCAD or Blender and scale it and modify to your heart’s (or printer’s) content. Since all of the cool kids are apparently doing it, I’ve put this stuff into a GitHub repository. Download: git clone git@github.com:nrpatel/FaceCube.gitfacecube.pymeshing.mlx

How Motion Detection Works in Xbox Kinect | Gadget Lab The prototype for Microsoft’s Kinect camera and microphone famously cost $30,000. At midnight Thursday morning, you’ll be able to buy it for $150 as an Xbox 360 peripheral. Microsoft is projecting that it will sell 5 million units between now and Christmas. We’ll have more details and a review of the system soon, but for now it’s worth taking some time to think about how it all works. Kinect’s camera is powered by both hardware and software. Older software programs used differences in color and texture to distinguish objects from their backgrounds. Time-of-flight works like sonar: If you know how long the light takes to return, you know how far away an object is. Using an infrared generator also partially solves the problem of ambient light. PrimeSense and Kinect go one step further and encode information in the near-IR light. With this tech, Kinect can distinguish objects’ depth within 1 centimeter and their height and width within 3 mm. Story continues …

Synapse for Kinect SYNAPSE for Kinect Update: There’s some newer Kinect hardware out there, “Kinect for Windows”. This hardware is slightly different, and doesn’t work with Synapse. Be careful when purchasing, Synapse only supports “Kinect for Xbox”. Update to the update: There appears to also be newer “Kinect for Xbox” hardware out there.

Related: