using artificial intelligence, creative ad agency redpepper has developed a facial recognition robot capable of identifying and pointing to waldo, with a top speed clocked at 4.45 seconds. named ‘there’s waldo,’ the robot tests google’s new autoML vision service, equipped with an arm that is controlled by raspberry pi along with a pyarm python library for the uarm metal.
robot wheres waldo
the robot takes images stored in google’s new autoML vision service as a learning platform to identify waldo

 

 

essentially, the arm extends, takes a picture of the canvas below, then uses openCV to find and extract faces from the photo. these faces are then sent to the google autoML vision service, which compares each face against the waldo model it has learned to identify. in an email interview with the verge, matt reed, the creative technologist at redpepper who led the project, explained that ‘there’s waldo’ built a data model training set of only ‘62 distinct waldo heads and 45 waldo heads plus body.

robot wheres waldo
the robot takes an image of the entire canvas and cross references the faces from learning model

 

 

if the robot has a confidence match of 95% or higher, the arm is instructed to extend and ‘point’ to the coordinates of the matching face on the canvas. if there are multiple waldos in a photo it will point to each one.

    have something to add? share your thoughts in our comments section below.

    comments policy
    LOG IN
    designboom's comment policy guidelines
    generally speaking, if we publish something, it's because we're genuinely interested in the subject. we hope you'll share this interest and if you know even more about it, please share! our goal in the discussion threads is to have good conversation and we prefer constructive opinions. we and our readers have fun with entertaining ones. designboom welcomes alerts about typos, incorrect names, and the like.
    the correction is at the discretion of the post editor and may not happen immediately.

    what if you disagree with what we or another commenter has to say?
    let's hear it! but please understand that offensive, inappropriate, or just plain annoying comments may be deleted or shortened.

    - please do not make racist, sexist, anti-semitic, homophobic or otherwise offensive comments.
    - please don't personally insult the writers or your fellow commenters.
    - please avoid using offensive words, replacing a few letters with asterisks is not a valid workaround.
    - please don't include your website or e-mail address in your comments for the purpose of self-promotion.
    - please respect jury verdicts and do not discuss offensively on the competition results
    (there is only one fist prize, and designboom usually asks renown professionals to help us to promote talent.
    in addition to the awarded designs, we do feel that almost all deserve our attention, that is why we publish
    the best 100-200 entries too.)

    a link is allowed in comments as long as they add value in the form of information, images, humor, etc. (links to the front page of your personal blog or website are not okay). unwelcome links (to commercial products or services of others, offensive material etc. ) will be redacted. and, ... yes, spam gets banned. no, we do not post fake comments.

    PRODUCT LIBRARY

    a diverse digital database that acts as a valuable guide in gaining insight and information about a product directly from the manufacturer, and serves as a rich reference point in developing a project or scheme.

    technology news