That's a high-speed computer-vision optical pea sorter. Yes, each and every pea in that huge flow of peas is examined by a computer vision system. Tiny high-speed air jets are kicking out the rejects during the brief period the peas are in free flight.
Here's a blueberry sorting machine, throwing out anything that doesn't look like a round blue blueberry:
The food industry has lots of machines like that. The technology was first applied to large fruit like tomatoes. It's now so cheap it's applied to rice and grains.
Ha, came here to post this as well. High speed is relative :] I've done similar hardware things in the past and my initial ideas when I read the orignal article were:
- what kind of sensor are they using that they need 2 seconds to scan?
- in comparision with 2 seconds, a phone camera with results sent over bluetooth is indeed fast. Not my branch at all, but I wonder what latencies he's looking at? Should surely be tens if not hundreds of mSec?
I don't get a sense how the first machine actually does the physical separation, but the second one seems to be an air jet or something?
That second machine seems to have quite a lot of false positives, but I guess better waste some blueberries than have to deal with customers finding beetles in their berries.
The pea-sorting machine, like all the small-item sorters, uses a row of small air jets controlled by the computers. Here's a more advertising-like video with slow-motion imagery of the action at the air jet station.
It's amazing that individual sorting of rice grains is affordable, but it is.
Larger fruit and vegetable items used to be graded by people, but there are machines for that, too.
Machinery like this helps to make "Amazon Fresh" possible. With computers inspecting produce, there's less need for people to shop for it themselves. Webvan tried to do this 15 years ago and had quality complaints. That problem has been solved.
Sigh... They'll still buy it if it looks perfect but tastes like unripened cardboard. :/ (Homegrown, imperfect tomatoes rock.). "Imperfect" but edible food goes on to canning, pies and other manufactured items.
A friend of mine developed a machine that separates pistachios by amount of "openness" of the their shell. They user image processing and had to it one by one in a pipe because they had to scan the pistachio from multiple angle to make the decision.
My dad used to work for Key Technology. They did some fascinating stuff. They had teams of hardware engineers trying to push as much sorting logic into hardware to meet the speed requirements they were looking for.
I saw their stuff in action in french fry plants in Idaho. Awesome stuff, especially considering the hostile environment those machines are deployed in.
Silly fool, this hobbiest! How dare he publish his homegrown, COTS work on the internet, lest we pedantic assholes compare him to well-funded, full-time engineering efforts.
In what now seems like a previous life, I once had a job sorting produce by hand (mostly picking out stick/stems, and animal parts) from a conveyor belt zipping in front of me. Even back then CV machines existed for at least some produce, but the plant I was working at had not yet updated.
This kind of work required a dozen or more people standing along the (much slower) conveyor belt, each trying to grab what the previous worker missed. Even at minimum wage, that sort of labor isn't cheap. This is truly amazing technology.
Now I understand why the produce I get from the grocery store is always so bruised compared to the stuff I get out of my garden. Even the good product moves at quite a clip and is dropped quite harshly, too.
I wonder, (and wouldn't be surprised) if the M&M factory already has something similar in place for Quality Control. Anyone working in/near the food industry know the answer to this?
I am pretty sure they get made 1 color at a time, they wouldn't be combined before being inspected... Why combine then go through a new machine to uncombine?
Fluorescence-activated cell sorting uses the same idea as in the M&M sorter linked here, except with lasers instead of an iPhone camera and uses an electron gun to deposit charge onto a droplet containing exactly one cell as it falls through a magnetic field to sort it into bins. Madness!
Very cool. I just picked up a couple Mindstorms kits and have been debating my first build challenge. This looks perfect (though it won't be as quick I'm sure)
Edit: Just playing with the math regarding the speed of this machine considering the M&Ms are in free fall. Nicely done!
So it puts all M&Ms in one pot and Skittles in the other? Or so that it can deal with all the different colours between the two?
The first would be tricky!
Very nice. If you want to reduce the shadows for sorting browns, try backlighting the chute so that shadows can't appear on it. Basically, turn the chute into a photography light box.
oh the glue, the glue! M&M sorters are great projects though. I am impressed that the bluetooth link has the frequency response to actually get to the blue ones before they have fallen what appears to be a few inches.
"This American Life" did a great segment explaining (as does your wikipedia link) why the M&M's were a legit safety concern--and not just a prima-donna move by self-indulgent rock stars:
IIRC, the reason they have strange requests is so they know the crew actually went through the list and fulfilled all requests. Asking for only red M&M sounds silly but if you see a bowl of red M&Ms in your trailer, you know the crew was more likely to be diligent with the other requests. Those other requests being sound equipment and safty measures.
The point wasn't to have red M&Ms, though they taste good, it was a test to see how well the crew followed instructions.
I first heard the story as an urban-legend-style tale about the crazy foibles of famous people, but I love that it was driven by practical considerations.
https://www.youtube.com/watch?v=DogZJmThRSE
That's a high-speed computer-vision optical pea sorter. Yes, each and every pea in that huge flow of peas is examined by a computer vision system. Tiny high-speed air jets are kicking out the rejects during the brief period the peas are in free flight.
Here's a blueberry sorting machine, throwing out anything that doesn't look like a round blue blueberry:
https://www.youtube.com/watch?v=8CyWvnh4YtE
That machine could sort M&Ms by color, easily.
The food industry has lots of machines like that. The technology was first applied to large fruit like tomatoes. It's now so cheap it's applied to rice and grains.