Movin’ Klee: A Paul Klee ARt Installation

March 26, 2014



A group of students from the University of Applied Sciences in Augsburg are using Augmented Reality to expand a series of secret paintings created by Paul Klee while he served as the treasurer’s typist at the Royal Bavarian Flying School in the early- to mid- 1900s.

The students created their own application as part of the Master’s course “Interactive Media” in cooperation with the Paul Klee exhibition “Mythos Fliegen” (“The myth of flying”). They choose eleven different pieces of art from the Klee exhibition to enhance with color and animation, with the goal being that visitors should experience something entirely new while visiting the exhibition and still being able to appreciate the original artwork.

Image Courtesy: Movin'Lab

Image Courtesy: Movin’Lab

The Movin’ Klee application was developed for iOS and Android devices and related animated content is overlaid over images from the real paintings. Due to safety reasons in the exhibition, the AR installation could not be directly integrated into the museum walk through, but is rather set up just outside of the main gallery. The application was well publicized to visitors, and they could even  use the museum’s internet connection to download and install the application on site.


Movin’ Klee consists of a native application as well as a Junaio plugin that interface with augmented reality forms. The native apps are written in the corresponding programming languages for Android and iOS. The augmented reality part, which is the located on the Junaio-server channels, is developed in the programming languages ​​PHP, HTML, AREL and jQuery. This channel represents a type of browser where the augmented reality objects (animations) are loaded and played.  Britta Diehm, Xiaomeng Jiang, Yue Ma and Kerstin Vierthaler developed the native application as part the project group Movin’Lab.



Kerstin Vierthaler, one of the developers, wrote her master’s thesis on the integration of Augmented Reality into museums and came to an interesting conclusion:

“The study of the animated Movin’ Klee application shows that customers remembered the Augmented Reality related paintings better than non-animated pictures, since animations raise the viewers’ attention and perception. Besides the better memorization of paintings, the rather unknown technology itself was very interesting for the visitors. [...] Furthermore, the intuitive usability makes the application accessible for visitors who are not experienced with applications. [...] The evaluation reveals that it is important to inform the visitor about digital offerings within the exhibition. In addition to the technical challenge the museum’s internal integration and communication plays an important role.”

For more information about Movin’ Klee, please visit their website.


Augmented Reality at Trade Shows

May 11, 2012

We are very happy to share the great news: our technology has been used for the first time at fairs for official communication! Our Certified Developer Concepteers GmbH has developed the Drupa app based on the junaio Plugin for the Drupa fair, which serves the print and media industry. This is a great example showing that metaio‘s software is a unique tool for bringing extra content to various scenarios and usage models.

In the last year AR rapidly established an interesting and more personal connection between product and end-user. When the reader sees the advertisement via a smartphone or a tablet using the mobile application based on the junaio software, a 3D animation starts up on the screen.  This directs the user to the Drupa’s website, which provides extra content to the exhibition.



Although print is still the leading medium, this digital innovation elevates the traditional, well known print to a whole new level by making it helpful and exciting. AR establishes a unique dialog between the company and the user bringing the latest information right into the customer’s hands and providing up-to-dated information just a click away.

Concepteers has many years of experience in the media industry combined with solid experience in the IT business consulting. Concepteers develop cross marketing concepts to successfully target their audience through a multi-channel strategy. They have become metaio’s Certified Developer based on exceptional quality of their work on the metaio’s Augmented Reality junaio Plugin software.

Concepteers Creative Director Michael Sommer at the annual Drupa convention

junaio is software like no other.  It is smart and offers brilliant opportunities too. Using junaio developers can create interesting applications like the Drupa app. AR is a great potential for buyers, advertisers and service providers. Thanks to junaio the classic ways of communication are now upgraded to a new level, providing experiences like never before.

insideAR 2011 Exhibition Highlights [Video]

October 7, 2011

Hopefully by now you’ve all seen the teaser video and read about the very, very cool announcements we made at insideAR this year. I honestly wish that I could adequately describe insideAR. Maybe it’s because I helped assemble and move 15-20 very heavy table. Maybe watching these camera arrays and industrial prototyping demos come to life, piece by piece gives one more of an appreciation in seeing the finished product. Maybe it was just my first time in Germany, combined with the anticipation of Oktoberfest in Bavaria, combined with the excitement of meeting all of the people with whom I’ve only ever communicated via Skype or telephone or email. Luckily, we don’t have to rely on my floundering attempts at description- we have videos!

This is the first clip of many that we plan to roll out over the coming days and weeks, demonstrating the current and future technologies under the hood (sometimes literally) of metaio.

insideAR was divided into various exhibition segments- one of these was called “Augmented Living”, where we demonstrated some of the potential uses of AR in the household, including the new junaio 3.0 SCAN release that allows the user to get pricing and ingredient information from grocery item barcodes. In that same area, we were also showing our Bosch 3D studio app for iPad that allows people to practically redesign their kitchens with new appliances- without ever leaving their homes.

Many attendees played around with the Around Me Geo Trivia junaio game is a very creative example of how gaming, education and mobile AR can work together to shape an engaging user experience. Sensor fusion takes elements that we tend to take for granted — orientation, geographical relative position, radial distance — and translates them into usable information- in this case, a very fun trivia game.

Our company was built on out-of-the-box industrial solutions, so it should be no surprise to see those prototyping examples in the above video. The sub-millimeter tracking with a guided camera-arm would allow any manufacturer the highest digital scrutiny in examining a prototype on the factory floor; and with the “window-to-the-world”-type 3D mapping you can overlay the original wireframe to the real-word object itself, regardless of its size. With this kind of technology, metaio is naturally bridging the industrial gap between the digital creation and the physical construction of a given product.

Really cool stuff we’re talking about here. Really cool.

Once again, we’re going to be rolling out all sorts of video in the near future, so be sure to either subscribe to this blog or to our YouTube channel (or both!) in order to stay posted.

Augmented Reality On Every Smartphone by 2014

October 5, 2011

If you haven’t heard from TechCrunch, Dexigner, or, this year’s insideAR brought some very significant developments for metaio. To sum it up, we made three important announcements to over 450(!) attendees:

  • The release a free version of the Mobile SDK, soon to be integrated with a game engine
  • The release of an AR-publishing tool, junaio Creator, to enable virtually anybody to create AR content for junaio
  • Strategic partnerships with the leading chipset IP supplier ARM and mobile platform developer ST-Ericsson on joint R&D

What this means for the industry

Mobile SDK is now free

This is a big deal. AR is a young industry- we want to see it into adulthood. We want developers, researchers, students, newcomers etc to be able to test the limits of their imaginations and creativity with one of the most comprehensive and advanced mobile AR solutions out there. I can’t wait to watch these independent developers shape the future of AR applications in their endeavors.

The junaio Creator

User interface and workflow are two of the most important things that any software provider must consider- we want both of these aspects to be more streamlined, more convenient, more natural- and that’s why we announced the junaio Creator. It’s tool that takes all of the image recognition, the natural feature tracking, and the complex algorithms of junaio and reduces that magic to two simple words: point and click. Whether  you’re creating a junaio channel or utilizing our junaio Plugin to add a feature to an existing app, the junaio Creator allows you to do this without a single line of code. Check out the demo in the TechCrunch article and see for yourself.

Formal Collaborations with ARM & ST-Ericsson

I’ve been saying this for years: the surest way to enable the smoothest most immersive AR experiences is to ensure the optimization of the hardware. Though we’ve already been optimizing our software for these wonderful mobile devices that pepper our lives, metaio can now work directly with these processing and chipset providers to find the best way to ensure that mobile devices are AR-ready before they hit the shelves.

In closing



We have a genuine passion for what we do.  It may seem as though we ‘re making bold statements, but please understand that it comes from a shared excitement, an almost child-like fascination in its innocence at seeing dreams becoming reality, not just 3D and digital content (though we do that too).

Augmented Reality on Every Smartphone by 2014- It will be magic.


Japanese digital pop-star now dancing on tables in AR

September 19, 2011

  Hatsune Miky is an adorable, completely digital Japanese celebrity created by Crypton Future Media in 2007 using YAMAHA’s “Vocaloid” Software. The (evidently) 16-year-old, 5’2” songstress’s voice has been samples in thousands and thousands of user-generated videos, audio tracks, animations etc. Her albums have even topped the Japanese charts- not bad for a girl that doesn’t exist!

Hatsune Miku may be a digital construct, but the great thing about Augmented Reality is that we can take digital and 3-D content and breathe life into it by placing it in the physical world. A virtual entity could assume all three dimensions and interact with the real world- and that’s exactly what we did for the beautiful Hatsune Miku in this most recent development for Toyota.

Toyota has been enamored with Hatsune Miku for quite some time now- they’ve produced numerous (and clever) video spots featuring the star interacting with people as though she were a real person, as well as print ads, billboards (they’re everywhere here in San Francisco) and an integrated social media campaign. We were happy to be able to (literally) bring a new dimension to Hatsune Miku’s recent introduction to the states.

iOS users can immediately access the experience by downloading the free Toyota Shopping Tool App in the iTunes App store. An Android update is coming soon, but until then users with Android devices can download metaio’s free mobile AR browser, junaio, and search for the “Hatsune Miku” channel to get the same cool performance. Once the app is launched, just point the camera at the image below (called a “ToyoTag“) to see Hatsune Miku singing “Big Dream” and dancing alongside her favorite vehicle, the 2011 Toyota Corolla.

metaio used the junaio Plugin to develop this app for a Toyota, a feature that combines the technology, audience (1.7 Million Downloads) and accessibility of junaio, the most advanced mobile Augmented Reality browser, with the added value of a custom branded white-label application. We were able to use the same superior image recognition technology and tracking algorithm as we use in junaio to integrate this experience directly into Toyota’s mobile app as if it were a white-label application. Even better, the modular structure of the Plugin allows content to be easily and efficiently modified and changed, making the junaio Plugin a great development and branding solution.

Read the full press release here, and be sure to stay posted on all of Hatsune Miku’s exploits in America with Toyota. And make sure to check out this great video of the experience below:


Get every new post delivered to your Inbox.

Join 5,066 other followers