fujitsu's augmented reality touchscreen interface
fujitsu's augmented reality touchscreen interface fujitsu's augmented reality touchscreen interface
apr 22, 2013

fujitsu's augmented reality touchscreen interface

fujitsu’s mindblowing augmented reality touchscreen interfaceimage © diginfo



fujitsu laboratories has developed an augmented reality user interface which can accurately detect the users finger and what it is selecting, creating an interactive touchscreen-like system using off-the-shelf cameras and projectors. from the technology, real-world information such as text from books or printed images can be imported from a document. the function enables a user to trace a finger across a document on a table, copy it as digital data, and display it virtually.


‘we think paper and many other objects could be manipulated by touching them, as with a touchscreen. this system doesn’t use any special hardware; it consists of just a device like an ordinary webcam, plus a commercial projector. its capabilities are achieved by image processing technology.’



touchscreen interface for seamless data transfer between the real and virtual worldvideo courtesy diginfonews



augmented camera captureimage © diginfo



recognizing and converting coordinates of physical objects and ICT equipmentimage courtesy fujistu



the technology that uses a camera to automatically measure irregularly shaped objects on a table and then automatically adjust the coordinate systems for the camera, projector and the actual objects. this makes it possible for the software to take the finger movements and touching of objects made by the user, and then match them with the digital display projected onto physical objects.



stabilization of finger recognition technologyimage courtesy fujistu



the system recognizes the shape of the user’s fingers by extracting the fingers’ colors and contour features. other controls the colorand lighting of the camera image, depending on the surrounding ambient light, along with technology that corrects for differences among individual fingers. a stable extraction of the form of the user’s fingers, one that is minimally impacted by the environment and individual variations, can be obtained.



accurate and rapid fingertip recognition technologyimage courtesy fujistu



by enhancing images of the user’s fingertips, the technology is able to obtain a level of precision that is sufficient for touch detection, even using low-resolution images that can be captured on a regular webcam. moreover, the technology is capable of fingertip tracking speeds of 300 mm per second, thereby enabling it to follow natural finger movements.

    have something to add? share your thoughts in our comments section below.
    all comments are reviewed for the purposes of moderation before publishing.

    comments policy
    LOG IN
    designboom's comment policy guidelines
    generally speaking, if we publish something, it's because we're genuinely interested in the subject. we hope you'll share this interest and if you know even more about it, please share! our goal in the discussion threads is to have good conversation and we prefer constructive opinions. we and our readers have fun with entertaining ones. designboom welcomes alerts about typos, incorrect names, and the like.
    the correction is at the discretion of the post editor and may not happen immediately.

    what if you disagree with what we or another commenter has to say?
    let's hear it! but please understand that offensive, inappropriate, or just plain annoying comments may be deleted or shortened.

    - please do not make racist, sexist, anti-semitic, homophobic or otherwise offensive comments.
    - please don't personally insult the writers or your fellow commenters.
    - please avoid using offensive words, replacing a few letters with asterisks is not a valid workaround.
    - please don't include your website or e-mail address in your comments for the purpose of self-promotion.
    - please respect jury verdicts and do not discuss offensively on the competition results
    (there is only one fist prize, and designboom usually asks renown professionals to help us to promote talent.
    in addition to the awarded designs, we do feel that almost all deserve our attention, that is why we publish
    the best 100-200 entries too.)

    a link is allowed in comments as long as they add value in the form of information, images, humor, etc. (links to the front page of your personal blog or website are not okay). unwelcome links (to commercial products or services of others, offensive material etc. ) will be redacted. and, ... yes, spam gets banned. no, we do not post fake comments.


    a diverse digital database that acts as a valuable guide in gaining insight and information about a product directly from the manufacturer, and serves as a rich reference point in developing a project or scheme.

    technology news

    keep up with our daily and weekly stories
    491,979 subscribers
    - see sample
    - see sample