AI-driven robot learns how to rotate a cube with the dexterity of a human

AI-driven robot learns how to rotate a cube with the dexterity of a human

artificial intelligence research company openAI has trained a human-like robot hand to manipulate physical objects with unprecedented dexterity. ‘dactyl’ was taught entirely in simulation without any human input, and later transferred its knowledge to a real world robot, eventually manipulating a six-sided cube. ‘our results show that it’s possible to train agents in simulation and have them solve real-world tasks, without physically-accurate modeling of the world,’ the team at the elon musk co-founded company say.

robot hand rotates cube
dactyl achieved the tested maximum of 50 consecutive rotations



using a shadow dexterous hand, openAI placed a cube in the palm of the hand and asked dactyl to reposition it into a different orientation. dactyl learned to solve the object reorientation task entirely in simulation without any human input. ‘our approach, domain randomization, learns in a simulation which is designed to provide a variety of experiences rather than maximizing realism,’ the team say in a research paper on the project. ‘this gives us the best of both approaches: by learning in simulation, we can gather more experience quickly by scaling up, and by de-emphasizing realism, we can tackle problems that simulators can only model approximately.’

robot hand rotates cube
dexterous manipulation behaviors autonomously learned by dactyl



using humanoid hands to effectively manipulate objects has proved a long-standing challenge in robotic control. the completion of this project achieves a full cycle of artificial intelligence development that openAI has been working on for the past two years.

robot hand rotates cube
training images used for learning to estimate the pose of the block

robot hand rotates cube
dactyl lab setup with shadow dexterous hand, phasespace motion tracking cameras, and basler RGB cameras

robot hand rotates cube
this project completes a full cycle of AI development openAI has been pursuing for the past two years


    have something to add? share your thoughts in our comments section below.
    all comments are reviewed for the purposes of moderation before publishing.

    comments policy
    LOG IN
    designboom's comment policy guidelines
    generally speaking, if we publish something, it's because we're genuinely interested in the subject. we hope you'll share this interest and if you know even more about it, please share! our goal in the discussion threads is to have good conversation and we prefer constructive opinions. we and our readers have fun with entertaining ones. designboom welcomes alerts about typos, incorrect names, and the like.
    the correction is at the discretion of the post editor and may not happen immediately.

    what if you disagree with what we or another commenter has to say?
    let's hear it! but please understand that offensive, inappropriate, or just plain annoying comments may be deleted or shortened.

    - please do not make racist, sexist, anti-semitic, homophobic or otherwise offensive comments.
    - please don't personally insult the writers or your fellow commenters.
    - please avoid using offensive words, replacing a few letters with asterisks is not a valid workaround.
    - please don't include your website or e-mail address in your comments for the purpose of self-promotion.
    - please respect jury verdicts and do not discuss offensively on the competition results
    (there is only one fist prize, and designboom usually asks renown professionals to help us to promote talent.
    in addition to the awarded designs, we do feel that almost all deserve our attention, that is why we publish
    the best 100-200 entries too.)

    a link is allowed in comments as long as they add value in the form of information, images, humor, etc. (links to the front page of your personal blog or website are not okay). unwelcome links (to commercial products or services of others, offensive material etc. ) will be redacted. and, ... yes, spam gets banned. no, we do not post fake comments.


    a diverse digital database that acts as a valuable guide in gaining insight and information about a product directly from the manufacturer, and serves as a rich reference point in developing a project or scheme.

    technology news

    keep up with our daily and weekly stories
    501,538 subscribers
    - see sample
    - see sample