Dueling Realities at Hand

In the Atlantic,   " ... Augmented-reality systems could edge out virtual reality and re-imagine human perception in the process. ... "   A topic of continuing interest.  Is it easier to overlay a reality on our own reality, or create one from scratch? Note Apple's recent acquisition of Metaio,  Microsoft's Hololens.  Google's VR,   Big players are serious about this.  At home and at work.    The topic reminded me the animation technique called rotoscoping that uses real world images to create an artificial world. Could the deeper blending of realities be appropriate?

More on the Apple Metaio Acquisition

In ReadWrite:  Comparison to other efforts about augmented reality at Microsoft and Google.   Metaio brings in a clear maturity in the space, with applications in retail and with automakers. Impressed with my conversations with them.  Have experimented with their smartphone navigation App.

" ... Metaio began as a project inside Volkswagen in 2003 to build a platform for augmented-reality experiences. It later spun out of the German automaker. One of the projects the firm has worked on in the past is a showroom app for Ferrari that lets users overlay various virtual graphics on top of the cars in front of them. ... " 

Apple Acquires Metaio

In CWorld: Apple acquires German augmented reality company Metaio.  I have written about Metaio a number of times in this blog.  Impressive application of the technology to real business problems. This shows real seriousness of Apple in this space.

Ferrari Augmented Reality POS

Good example via Metaio:  Expanding showroom experience.  " ... Ferrari Australia commissioned developer ZSPACE to create an awesome showroom companion that overlays cinematic 3D animations right onto the vehicles themselves. Not only are the visuals extremely impressive – what is going on “under the hood” of the application is also at the cutting edge. By Making use of Metaio’s proprietary 3D tracking technology, the application render Hollywood-style visual effects onto the real-world vehicle in real-time. ,,, " 

BBC Overviews Augmented Reality

A good view in the BBC of the current state of augmented reality and mention of a number of real commercial applications in place.  For example, the IKEA catalog, previously covered in this space. See also AugmentedPixels, a Ukranian company I have watched for some time. Metaio is another notable player, covered here. But one thing that is often forgotten is the deeper intelligence level that could also be provided to augment reality, beyond their usual information layer.  Intelligence naturally augments vision, place and need.

Proposed Thermal Imaging Wearable AR Headset

New from Metaio. A video describe the future possibilities.  Another level of sensor data will be possible.   In the press release: " ... With “Thermal Touch”, a wearable headset user could turn any surface into a touch-screen: Imagine pushing directions to your device simply by touching a static map in a shopping mall, building complex or airport; children could bring play to new levels and launch digital content directly from their toys; design professionals could visualize their digital and 3-D creations on their real world counterparts; and service technicians could pull up information just by touching an object in real life.

“Thermal Touch” is a prototype and far from everyday usability. Metaio released the demo to educate the community on the possibilities of computer vision. It is likely that in 5-10 years infrared cameras may join a multitude of advanced sensors being integrated into devices everyday, including the wearable augmented reality headsets of the near future. ... " 

See Through Augmented Reality Screens

A competitive approach to ideas like Google Glass.  Wearable displays with floating screens.  But with built in augmented reality implications.  From the Metaio company, who we have connected with for some time.  Examining for alternative enterprise office applications.  To augment support for intelligent applications that are driven by analytics.  Have any ideas, contact me?   Press release.

Augmented Reality Toy Competition

I like the idea of connecting AR to toys.  It implies the connection of game dynamics as well. Can we then connect the ideas for serious purpose?  A competition sponsored by Metaio.  " ... Metaio, the worldwide leader in augmented reality (AR) software and solutions, and Berlin development studio Toywheel today announced the launch of the first global augmented reality development competition for toys and children’s games. The six-week competition will focus on the future of children’s entertainment, both in the toys themselves and how children will interact with digital media. Participation is open to both developers and non-developers, designers and even children , teenagers and parents with interesting ideas on the use of AR technology in the space ... "  

Augmented Reality and 3D Remote Manufacturing

Had explored the close connection between augmented reality and remote manufacturing / 3D Printing.  Its interesting to see that the AR company Metaio is now offering developer kits that support this connection.   They write:

“3-D cameras will soon arrive on mobile devices,” said Metaio CTO Peter Meier. “Developers and businesses alike will be able to take advantage of this new technology through the support for 3-D cameras in the Metaio SDK. This year in Barcelona we are showcasing how we have adapted our core technology to support this new wave of 3-D integration, while also demonstrating the power of silicon integration, especially with regard to a wearable future. AR has already shown usefulness and value in both enterprise and consumer sectors, and we will continue to lead the way in innovation for 2014.”

3-D integration opens up numerous possibilities for everyday use: consumers could visualize products in home without the need for markers or printouts; utilize gestures to interact with their devices and the real world; reconstruct or modify entire environments; or even create 3-D models on the fly that could be pushed to 3-D printing devices.  ... "

Augmented Reality for Wearable Computing

Integrate your contexts, both on you and around you.   I like the idea of having an all over aumentation as required.  This blog covers related topics. Via Metaio.

Augmented Reality Museum Tour

From Metaio.  Here using the example of a  museum tour.  An excellent example of the use of augmented reality.  Combining physical and artificial spaces to provide real time information.  We all do it today, using our smart phones to get information as we shop.  But AR takes it a step further, connecting spatial and location information to the mix.  Like when you are walking the halls of a museum, or the aisles of a retail store.

Linking Wearables and Augmented Reality

The vendor Metaio is speaking and displaying at the upcoming Consumer Electronics show.  The link between wearables and AR is obvious.   Particularly interesting is the mention of maintenance applications, which we explored for manufacturing applications.

" ... With smartwatches and Google Glass projected to sell tens of millions of units in the next few years, 2014 will begin a new era of wearable computing devices, all of which can be enhanced by visualization technology like Augmented Reality. Metaio, the Augmented Reality Company, will deliver live demonstrations with these devices on the exhibition floor at the 2014 Consumer Electronics Show.

Metaio will showcase both consumer-focused and enterprise augmented reality apps on the latest wearable computing platforms like the EPSON Moverio and the Vuzix M-100. Among the demonstrations shown will be a 3-D maintenance app for a Mitsubishi Electric HVAC unit; a demo that allows potential car buyers to switch out components on a vehicle; and “Mirage”, the first AR Browser for wearable computing.... " 

Service Manual AR from Metaio and VW

What is growing as an application for Augmented Reality, the delivery of automobile service manuals for a concept car.   Here for technicians.  GigaOM discusses.  Here is the Metaio press release with many more details. Will this follow with more widely used manuals for other complex consumer goods?

Hands Free Car Manual on Google Glass

Metaio's press release on their prototype augmented reality car manual, mentioned here before.    I note that this was precisely the area we explored, using 3D location to be able to do machine maintenance, by overlaying diagrams and physical spaces.   I think there are lots of opportunity in industry.   Includes a video of use at the link.

" ... The hands-free interactive car manual prototype developed by Metaio will be the first time that augmented reality on wearable computing will be shown to be productive and commercially viable.

Metaio R&D developed this new prototype as a proof-of-concept of the capabilities of its AR platform on wearable devices. A new type of 3-D tracking and recognition technology engineered by Metaio utilizes CAD models to recognize and overlay 3-D content onto the real world counterpart. Since no markers, GPS or point clouds are required, the stability of the augmented reality experience increases dramatically, while remaining almost immune to variable lighting, glare, position, and other environmental factors that tend to interfere with vision-based experiences ... " 

McDonald's and Augmented Reality

A good description of how McDonald's is using mobile augmented reality for corporate sustainability PR and positioning in Europe using games.  Via Metaio. " ... The new augmented reality app, "McMission" McDonald's Germany, is a playful approach educate McDonald’s visitors and mobile users on the company's commitment to sustainability. Coinciding with the publishing of McDonald’s third Corporate Responsibility Report, the app is now available on Google Play and the iTunes App Store for download. Through four interactive mini-games, visitors learn about the societal and environmental initiatives in which McDonald's and its franchisees are involved.  ... " 

Augmenting the Catalog

Have been exploring the latest 2014 physical IKEA catalog, with is an already large (320 page plus) slick paper catalog that broadly and artistically explores IKEA's offerings.   The catalog is then augmented by using the IKEA App from a smartphone.  You view select pages through the camera of a smartphone and you see a floating icon that can be clicked.  I found the use of the method not consistently easy, and I can see people frustrated by it.  A help section shows the remarkably large number of different kinds of displays.

The App also  allows you to download the full digital catalog,  which is augmented by icons on each digital page.


What you then get varies by page.  In some cases a web page of additional content, in others a video, in others a sizing method that lets you 'see' what a piece of furniture looks like in the room you are in.  Previewing its location through the camera.   You can see a different color or style of fabric on a couch.   Nicely done, part of the fun is seeing what each value add will be.  People are getting used to using methods like QR codes for more content.  This tries to link content to local physical states.   Thus augmented reality.

At first I thought that augmented catalog items needed to be marked by an orange plus sign. But any orange marking on the page is an indication of activation.  There are many,  That draws you through the catalog pages, if the additions are interesting enough.  But since the catalog is already large, it doesn't save much paper.

The additions are also dynamic, and can be remotely changed.  So the back cover has promotions and alerts.  All this works only if you continue to go back there to discover new things.   You can't order from the catalog, and have to go to the store, so although they can tell what you looked at and interacted with a page, they can't tell if it led to a sale.    I also found the little markers that tell you if a page is augmented hard to find. Time will tell if this method will be productive

The system has been developed for IKEA by Metaio, more about that here.

More in this blog on Augmented Reality.

Marketing and Augmented Reality

Have long been interested in the use of Augmented Reality for marketing, both in the store and in mobile.   Still early in its use, but it is evolving quickly now.   Good article on the topic in CMO.

" ... It's Not About The Technology

As with every other digital marketing innovation that has come along, marketers looking at AR can be subject to what Silva called the "bright, shiny object syndrome." Speaker after speaker advised that AR can't be an end in itself--that you have to think about the user benefit first. Uzzan described AR as an "enabler" only after you already have an idea.

Lisa Murphy, marketing manager at platform provider Metaio, put it this way: "The end consumer doesn't care about technology."

Murphy also said that the key to AR taking off as a marketing tool is "making digital a natural experience." During the "AR in Marketing and Advertising" session, the moderator asked what the most important trends in AR for marketing over the next 12 months would be. Murphy replied "usefulness"; Justin Farris, product manager at AR software developer GravityJack, replied, "compelling use cases"; and Scott Wellwood, VP at Total Immersion, said, "no gimmicks." ... ' 

Audi Releases Augmented Reality Manual

Metaio reports that Audi has released an augmented reality enabled manual, linked to a smartphone App.

" ... Metaio, world leader in augmented reality (AR) software and solutions and AUDI AG - global leader in luxury vehicles, today announced the release of the Audi A3 eKurzinfo augmented reality mobile application, available for free download on iOS devices.

After the success of the Audi eKurzinfo app for the Audi A1, which was nominated for the 2013 GSMA Global Mobile Awards for Best Mobile Solution for the Automotive Industry, Audi AG has extended the availability to the new Audi A3.

The new app can recognize over 300 individual elements of the Audi A3 – from the insignia on the windshield wipers and entertainment system to actual engine components under the hood – in order to return relevant how-to information or even virtual overlays of maintenance instructions animated in real-time 3-D. Metaio’s cloud-based architecture pushes digital information directly to the device, meaning the user will never have to update the app ... " 

More Smart Glasses

Its not all about the Google Glass idea.  The notion of head-wearable, camera enabled augmented reality is being promoted by a number of vendors.  Metaio reports on another example.  All of these ideas are augmented reality plays.  Metaio is a major software developer in this space. " ... “Wearable computing is the next step for natural, useful Augmented Reality,” said Metaio CTO Peter Meier. “In order to realize the dream of an always on, always augmented world, it is important to have software for developers ready, today, for smart glasses like the Vuzix M100.” ... " 

Metaio makes Hardware

Well  known German Augmented reality company Metaio opens a hardware innovation and development  facility in Dallas:

Metaio Opens New Office to Ramp up Augmented Reality Hardware R&D
Dallas, TX – April 17, 2013: Metaio today announces the opening of an all-new office in Dallas, Texas as part of a company-wide initiative to invest resources into research and development of Augmented Reality (AR) core technologies. At this year’s Mobile World Congress, Metaio announced the AREngine, the first-ever hardware IP dedicated to accelerating new Augmented Reality hardware interfaces, such as Google Glass.
Metaio and its network of clients and developers already benefit from an award-winning R&D team in its headquarters in Munich, Germany. As an expansion to the existing research efforts, the opening of the brand-new office in Dallas, Texas, will focus entirely on advancements and platform research in order to engineer the next generation of Augmented Reality software and devices.... "