Open-source project aims to give vision to hobbyists' robots

Charmed Labs and Carnegie Mellon are seeking $25,000 for an open-source project to build a low-cost camera

Charmed Labs' and Carnegie Mellon's Pixy open-source camera robot

Charmed Labs' and Carnegie Mellon's Pixy open-source camera robot

An open-source project aims to give a rudimentary eye to robots with the help of a camera that can detect, identify and track the movement of specific objects.

The Pixy camera sensor board, being developed by Charmed Labs and Carnegie Mellon University, can detect objects based on seven colors, and then report them back to a computer. A Kickstarter campaign was launched on Thursday to fund the US$25,000 project, and the organizations are on pace to reach full funding by the end of the day.

Adding the Pixy could be viewed as giving robots basic vision, said Rich LeGrand, founder of Charmed Labs.

"Once you have vision, then you can introduce the idea of tasks," LeGrand said. "If you want a robot to charge itself, that's a simple example of a task. This will get you there. If you want to a robot to navigate, this will get you there."

The camera can recognize simple items based on color, like a purple dinosaur, or a green ball. Objects are also recognized by specific color markings or codes. For example, a power outlet can be recognized by the Pixy when specific color stickers are placed next to each other on the object. Interestingly, the color-coding mechanism is also used in Mumbai as a low-tech way for the "dabbawallas" -- or people delivering lunch boxes -- to figure out where food needs to be delivered.

The Pixy can also be "taught" what to recognize based on color codes, and algorithms for that can be programmed into the board. A software called PixyMon, which works on Macs and PCs, processes the algorithm and visual information received from the Pixy and reflects the image and objects on a screen.

"If you're willing to color tags and objects that you're interested in... this is a great sensor. It'll find these objects, it'll find hundreds of them, and it will give you the results back," LeGrand said.

The robot can deliver the results back to a computer through multiple output mechanisms, giving hobbyists many ways to process information. Pixy has ARM-designed Cortex-M0 and Cortex-M4 cores, a 1280 x 800-pixel sensor, 264KB of cache and 1MB of flash storage. Robots based on the popular Arduino microcontroller can be hooked to the Pixy, LeGrand said.

The hardware can process images with a resolution of 640 x 480 pixels at 50 frames per second. It's possible to track basic images in real time, and the image processing doesn't bog down the CPU, LeGrand said.

Cameras have been a part of robotics since the 1990s, but expensive to implement, LeGrand said.

His goal with the Kickstarter project is to buy parts and make a cheap camera accessible to the wider robotics and hobbyist communities. The project will also fund the development of future versions of Pixy, and he has the backing of the respected robotics department at Carnegie Mellon.

"I thought hey, try to keep to keep the cost down, keep it robust... and people would use it for different projects," LeGrand said.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags Carnegie Mellon Universityopen sourceconsumer electronicsroboticsKickstarterArduinosoftware

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Agam Shah

IDG News Service
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?