The first self-checkout system was installed in 1986 at a Kroger grocery store outside of Atlanta. It took several decades, but the technology has finally proliferated across the United States. Given the automated direction grocery stores are taking, it seems like robotic bagging can't be far away.
MIT's CSAIL department is presenting this week RoboGroceryIt combines machine vision with a soft robotic gripper to pack a wide range of different items. To test the system, the researchers placed 10 unfamiliar objects on a supermarket conveyor belt.
The products ranged from delicate items such as grapes, bread, kale, muffins and cookies to more solid items such as soup cans, food boxes and ice cream tubs. The vision system activates first, detecting the objects before determining their size and orientation on the conveyor belt.
When the gripper touches the grapes, the pressure sensors in your fingers determine that they are, in fact, delicate and therefore should not go to the bottom of the bag, something many of us no doubt learned the hard way. You then notice that the soup can has a more rigid structure and you push it into the bottom of the bag.
“This is an important first step for robots to package food and other items in real-world environments,” said Annan Zhang, one of the study's lead authors. “Although we are not yet ready for commercial implementation, our research demonstrates the power of integrating multiple sensing modalities into soft robotic systems.”
The team notes that there is still plenty of room for improvement, including upgrades to the gripper and imaging system to better determine how and in what order to pack things. As the system becomes more robust, it could also be expanded outside the supermarket to more industrial spaces, such as recycling plants.
