facial recognition system tracks your reactions to movies

facial recognition system tracks your reactions to movies

understanding how spectators react to movies is disney’s latest experiment. in collaboration with caltech, and presented at IEEE’s computer vision and pattern recognition conference in hawaii, this new research shows how a facial recognition system will aid movie makers to understand the different emotions and reactions generated by films in the audience. the software simply monitors the viewer’s facial expressions through a method called factorized variational auto encoders, or FVAE.

disney research facial recognition system caltech designboom
the software monitors the viewer’s facial expressions through a method called factorized variational auto encoders (FVAE)



the facial recognition system was tested by disney research using infrared hi-def cameras that capture people’s faces while watching movies like ‘big hero 6’, ‘the jungle book’ and ‘star wars: the force awakens’. the results showcased 16 million facial landmarks from 3,179 viewers demonstrating a ‘very strong predictive performance’. to do so, the AI software takes the faces of people and understands how many of them are laughing, how wide are their eyes, and the different expressions they make.

disney research facial recognition system caltech designboom
the software is able to read your face and understand if you’re laughing, amazed or simply bored



‘with enough information, the system can assess how an audience is reacting to a movie so accurately that it can predict an individual’s responses based on just a few minutes of observation,’ commented peter carr, a disney research scientist.

 disney research facial recognition system caltech designboom
the AI will learn as it’s being used, resulting in more accurate results the more it’s employeed



‘understanding human behavior is fundamental to developing AI systems that exhibit greater behavioral and social intelligence. for example, developing AI systems to assist in monitoring and caring for the elderly relies on being able to pick up cues from their body language. after all, people don’t always explicitly say that they are unhappy or have some problem.’ says yisong yue from caltech.

    have something to add? share your thoughts in our comments section below.
    all comments are reviewed for the purposes of moderation before publishing.

    comments policy
    LOG IN
    designboom's comment policy guidelines
    generally speaking, if we publish something, it's because we're genuinely interested in the subject. we hope you'll share this interest and if you know even more about it, please share! our goal in the discussion threads is to have good conversation and we prefer constructive opinions. we and our readers have fun with entertaining ones. designboom welcomes alerts about typos, incorrect names, and the like.
    the correction is at the discretion of the post editor and may not happen immediately.

    what if you disagree with what we or another commenter has to say?
    let's hear it! but please understand that offensive, inappropriate, or just plain annoying comments may be deleted or shortened.

    - please do not make racist, sexist, anti-semitic, homophobic or otherwise offensive comments.
    - please don't personally insult the writers or your fellow commenters.
    - please avoid using offensive words, replacing a few letters with asterisks is not a valid workaround.
    - please don't include your website or e-mail address in your comments for the purpose of self-promotion.
    - please respect jury verdicts and do not discuss offensively on the competition results
    (there is only one fist prize, and designboom usually asks renown professionals to help us to promote talent.
    in addition to the awarded designs, we do feel that almost all deserve our attention, that is why we publish
    the best 100-200 entries too.)

    a link is allowed in comments as long as they add value in the form of information, images, humor, etc. (links to the front page of your personal blog or website are not okay). unwelcome links (to commercial products or services of others, offensive material etc. ) will be redacted. and, ... yes, spam gets banned. no, we do not post fake comments.


    a diverse digital database that acts as a valuable guide in gaining insight and information about a product directly from the manufacturer, and serves as a rich reference point in developing a project or scheme.

    technology news

    keep up with our daily and weekly stories
    502,546 subscribers
    - see sample
    - see sample