MIT's robotic arm masters dexterity by teaching itself how to see

MIT's robotic arm masters dexterity by teaching itself how to see

researchers at MIT’s computer science and artificial intelligence laboratory have developed a robotic arm with the ability to handle any object by studying how best to pick it up. the system, called dense object nets (DON), builds on technology that enables robots to make basic distinctions between items. DON takes this one step further by letting robots inspect random objects, and visually understand them enough to accomplish specific tasks without ever having seen them before.

MIT's robotic arm masters dexterity by teaching itself how to see

images courtesy of MIT



the system looks at objects as collections of points that serve as sort of visual roadmaps. this approach lets robots better understand and manipulate items, allowing them to pick up a specific object among a clutter of similar. this sort of tech could prove a valuable skill for the kinds of machines that companies like amazon and walmart use in their warehouses. DON could be used by a robot to grab onto a specific spot on an object like the tongue of a shoe. from that, it can look at a shoe it has never seen before, and successfully grab its tongue.


many approaches to manipulation can’t identify specific parts of an object across the many orientations that object may encounter,’ research author lucas manuelli says in an MIT press release. ‘for example, existing algorithms would be unable to grasp a mug by its handle, especially if the mug could be in multiple orientations, like upright, or on its side.’

MIT's robotic arm masters dexterity by teaching itself how to see



the team trained the system to look at objects as a series of points that make up a larger coordinate system. it can then map different points together to visualize an object’s 3-D shape, similar to how panoramic photos are stitched together from multiple photos. as well as in industrial settings, MIT researchers think DON could prove useful in the home, tidying up general clutter, or performing specific tasks like putting away the dishes.

    have something to add? share your thoughts in our comments section below.
    all comments are reviewed for the purposes of moderation before publishing.

    comments policy
    LOG IN
    designboom's comment policy guidelines
    generally speaking, if we publish something, it's because we're genuinely interested in the subject. we hope you'll share this interest and if you know even more about it, please share! our goal in the discussion threads is to have good conversation and we prefer constructive opinions. we and our readers have fun with entertaining ones. designboom welcomes alerts about typos, incorrect names, and the like.
    the correction is at the discretion of the post editor and may not happen immediately.

    what if you disagree with what we or another commenter has to say?
    let's hear it! but please understand that offensive, inappropriate, or just plain annoying comments may be deleted or shortened.

    - please do not make racist, sexist, anti-semitic, homophobic or otherwise offensive comments.
    - please don't personally insult the writers or your fellow commenters.
    - please avoid using offensive words, replacing a few letters with asterisks is not a valid workaround.
    - please don't include your website or e-mail address in your comments for the purpose of self-promotion.
    - please respect jury verdicts and do not discuss offensively on the competition results
    (there is only one fist prize, and designboom usually asks renown professionals to help us to promote talent.
    in addition to the awarded designs, we do feel that almost all deserve our attention, that is why we publish
    the best 100-200 entries too.)

    a link is allowed in comments as long as they add value in the form of information, images, humor, etc. (links to the front page of your personal blog or website are not okay). unwelcome links (to commercial products or services of others, offensive material etc. ) will be redacted. and, ... yes, spam gets banned. no, we do not post fake comments.


    a diverse digital database that acts as a valuable guide in gaining insight and information about a product directly from the manufacturer, and serves as a rich reference point in developing a project or scheme.

    technology news

    keep up with our daily and weekly stories
    486,484 subscribers
    - see sample
    - see sample
    privacy policy