Site Network: Home |

Hyperlinking Reality via Phones

Nokia researchers are working on a system that allows physical objects to be identified and connected to the Internet through mobile-phone screens.

By Kate Greene
MIT Technology Review

A Nokia research project could one day make it easier to navigate the real world by superimposing virtual information on an image of your surroundings. The new software, called Mobile Augmented Reality Applications (MARA), is designed to identify objects viewed on the screen of a camera phone.

The Nokia research team has demonstrated a prototype phone equipped with MARA software and the appropriate hardware: a global positioning system (GPS), an accelerometer, and a compass. The souped-up phone is able to identify restaurants, hotels, and landmarks and provide Web links and basic information about these objects on the phone's screen. In addition, says David Murphy, an engineer at Nokia Research Center, in Helsinki, Finland, who works on the project, the system can also be used to find nearby friends who have phones with GPS and the appropriate software.

The field of augmented reality, in which supplementary information from a computer or the Internet is overlaid onto the real world, has been the topic of science fiction and serious academic and military study for years. Historically, augmented-reality systems have required small backpacks with computing and networking hardware that stream information onto a visual display. But in recent years, researchers have been experimenting with more consumer-friendly ways to augment reality.

Mobile phones, in particular, are an appealing gateway to the virtual world. Their computing capabilities have increased substantially, and a growing number are GPS-enabled and can access high-speed data networks.

For the MARA project, Murphy and Nokia researcher Markus Kähäri outfitted a Nokia 6680 mobile device with a box containing extra hardware: a GPS sensor to determine the location of the phone, a three-access accelerometer to determine the orientation of the phone's camera (which could be directed at a building or the ground, for instance), and a compass .

Once the phone is in camera mode and capturing a video stream, Murphy explains, MARA pulls together the information from the three sensors to pinpoint the location and orientation of the phone. The software then scours a database of objects--which can be loaded onto a phone or can be accessed through a network connection--to determine which object would be visible to the camera. Once visibility is determined, MARA highlights the objects and provides extra information and hyperlinks if available. So, if a nearby restaurant is in the database and within view, the software could display the menu and wait time, and by clicking on the hyperlink, you could visit the restaurant's website.

This capability becomes particularly compelling when people, as well as buildings, are incorporated into the database. If you have a GPS sensor in your mobile device and elect to share your location, Murphy says, people could "click on you to link to your blog." He adds, "You could go to a football match and be able to see information on the players, or ball movement, or tactics by looking at the field with your device."

MARA has an additional feature, says Murphy. To access a satellite view of your location and nearby landmarks, simply point the phone's camera at the ground. The software infers the orientation and displays the map.

Murphy notes that the Nokia project is similar to a commercially available application in Japan by a company called Geovector. The Geovector software lets a person search for businesses near his or her location, and then it provides a series of arrows to direct him or her to, say, a coffee shop. But, Murphy says, the application does not annotate a scene on a mobile screen like MARA does. This see-through annotation makes it possible to view objects on the phone that are purely virtual, he says, like an information marker in the middle of a pavilion, or a work of virtual art overlaid on the side of a building.

Salil Pradan, the chief technologist of RFID at Hewlett Packard (HP), based in Palo Alto, CA, is encouraged that Nokia, a major phone manufacturer, is putting effort into research such as MARA. Pradan worked on a similar mobile-phone project at HP called Websign that began about six years ago but is no longer active. "We always believed that this kind of augmented reality with a cell phone is the way to move forward," he says. "I'm glad to see people like Nokia getting into that space."

Pradan says that the truly interesting applications will arise when the technology is opened up to software developers outside of Nokia so they can modify it to fit their needs.

Letting developers play with a commercial version of technology based on MARA could be feasible, says Murphy. After all, he says, the programming tools are already available for creating location-based applications that use GPS in the Nokia Series60 platform. "Hypothetically, if orientation and heading sensors were also to be embedded in the platform, one could imagine they could be made available to developers in a similar manner," he says.

However, at this time, Nokia has no plans to transform MARA into a commercial product. "Creating a prototype and creating a product are very different things," says Murphy. Some of the challenges are technical: minimizing power consumption in a phone with multiple sensors, and extended use of the camera. And some of the challenges are logistical: addressing privacy issues, and deciding the number and type of objects to maintain in the object database.

If the research did make it into a Nokia product, it would be exciting to see how people would use it, Murphy says. "There are so many possibilities engendered by bringing the Internet to the real world--making people linkable," he says. "It's hard to know what would be done with the technology if it were available."


At November 21, 2006 at 3:07 PM Anonymous said...

I like your work.
I would love to see some more blogging, more ben and bens notes rather than just news stories with your comments. Make it more of a blog.
All the best wishes,

At November 21, 2006 at 4:47 PM Ben said...

thanks Jim, I appreciate that a lot. I'm working on it...stay tuned. :-)


Post a Comment

This website does not recommend the purchase or sale of any stocks, options, bonds or any investment of any kind. This website does not provide investment advice. Disclaimer and Notices: Disclaimer: This website may contain "forward-looking" information including statements concerning the company's outlook for the future, as well as other statements of beliefs, future plans and strategies or anticipated events, and similar expressions concerning matters that are not historical facts. The forward-looking information and statements are subject to risks and uncertainties that could cause actual results to differ materially from those expressed in, or implied by, the statements. The information on this website includes forward looking statements, including statements regarding projections of future operations, product applications, development and production, future benefits of contractual arrangements, growth in demand, as well as statements containing words like believe, estimate, expect, anticipate, target, plan, will, could, would, and other similar expressions. These statements are not guarantees of future performance. Actual results could differ materially from the results implied or expressed in the forward looking statement. Additional information concerning factors that could cause actual results to differ materially from those in the forward looking statements are included in MVIS most recent Annual Report on Form 10-K filed with the Securities and Exchange Commission under the heading 'Risk factors related to the company's business,' and our other reports filed with the Comission from time to time. Except as expressly required by Federal securities laws, MVIS Blog undertakes no obligation to publicly update or revise any forward looking statements, whether as a result of new information, future events, changes in circumstances, or other reasons. Legal Notice: Although considerable care has been taken in preparing and maintaining the information and material contained on this website, MVIS Blog makes no representation nor gives any warranty as to the currency, completeness, accuracy or correctness of any of the elements contained herein. Facts and information contained in the website are believed to be accurate at the time of posting. However, information may be superseded by subsequent disclosure, and changes may be made at any time without prior notice. MVIS Blog shall not be responsible for, or liable in respect of, any damage, direct or indirect, or of any nature whatsoever, resulting from the use of the information contained herein. While the information contained herein has been obtained from sources believed to be reliable, its accuracy and completeness cannot be guaranteed. MVIS Blog has not independently verified the facts, assumptions, and estimates contained on this website. Accordingly, no representation or warranty, express or implied, is made as to, and no reliance should be placed on the fairness, accuracy, or completeness of the information and opinions contained on this website. Consequently, MVIS Blog assumes no liability for the accompanying information, which is being provided to you solely for evaluation and general information. This website does not contain inside information, proprietary or confidential information learned or disclosed as part of employment relationships or under nondisclosure agreements or otherwise.