AUGMENTED WORLDS Pt.1 - Business Opportunities: RECOGNITION.

An ‘iPad 4.0 – like prototype’ stroll around an augmented Sydney. Video, music devised & created by GARY HAYES of MUVEDesign.com – there are some key assumptions with this video detailed here -

ASSUMPTIONS WITH THIS CONCEPT

OK this tablet device with camera is running on a very fast connection, instant video and image so we are assuming city wide wifi or 4G type service connection. Also some elements pop up immediately so we can assume the user in the video (me) has setup some preferences or it has learned what type of service I like so it gives instant fulfilment vs dropping into endless menus (more on the interface next). Also the device is extremely aware of its location to a few inches, so we can assume that some of the ‘recognition’ elements are speeded up, being tied into precisely where the user is stood/orientated ‘combined’ with recognition – this will speed up the overall process vs using only Kooaba like Smart Visuals Recognition which puts a lot of pressure on server-side processing.

Notice on the bottom of the interface I have put the words “CONNECTED TO: Sydney CBD People and Places cached data” which is basically pointing out that the speed of recognition to data display is super accelerated when all information is pre-cached, and the way intelligent caching works means the more popular the ‘target’ the faster the response. Privacy – there are a few sequences here and in the longer video that show people being ‘recognised’. Obviously a real concern at the moment, so the concept video assumes the users being targeted have given their consent to outdoor recognition…I know this is a post in itself (see one of mine recently) but lets assume like TagWhat and FourSquare like services, users are allowing their ‘trusted’ friends and companies (for benefits) assess to being recognised – at least for the purposes of this concept!

But the purpose of this pretty detailed post is to simply list and try to categorise the many types of business Augmented Reality apps appearing in the market and to try to identify opportunities.

Augmented Reality Business by Gary Hayes

According to wikipedia, the first manifestations of AR appeared in the late 60s, became real in the 70s and by the 90s were already being used by major companies. Now portable computing is finally powerful enough to deliver AR to anyone who has a smart phone or latest generation PC or console. For those unfamiliar here is my simple definition of Augmented Reality.

Information, 3D models or live action blended with or overlaid onto the physical world around us, in real time. A camera & attached screen is used to view the combination of real world and metadata or rich media. Devices or systems commonly used for AR include:

• Mobile devices with inbuilt cameras such as iPhone, DS Lite, PSP or Android
• A head mounted display HMDs (eg: glasses or futuristic contact lenses) attached to a wearable networked computer
• A PC or Mac with webcam
• A games console with camera accessory
• A large TV screen with advanced Set Top box and Web cam
• Others in development

There will be hundreds of business, marketing and educational applications alongside the many 1st generation entertainment examples currently emerging. As usual the video game and porn industries are pioneering the research and development of the technology but we are about to see a plethora of more mundane utility & life enhancing applications about to swamp the market. Combine this with hundreds of space cadet ‘toys’ and viral fluff and we start to see the beginnings of a large industry. Of course the usual caveats apply but unlike say virtual worlds which suffered from too much early hype, these apps are much more accessible to anyone with a decent smart phone, up to date games console or computer with webcam – there is a big difference.

But before going onto my list (which is of course non-exhaustive) here are my basic types of Augmented Reality from a slightly technical perspective but which we can apply to commercial and marketing applications. My presentations and paper have much more detail with specific case studies of each.

GARY’S FIVE TECHNICAL TYPES OF AUGMENTED REALITY

1. Surface – The most understandable form of ‘reality that is augmented’ would be screens, floors, walls etc that respond to the touch of people in them providing them with virtual real time information or collaboration
2. Pattern – The AR system performs simple pattern recognition on a shape, marker (usually on a framed card in the real world scene) or face and replaces it with a static or moving element e.g: a 3D model, info, audio, video stream or loop etc: You view the ‘items’ in the scene with you
3. Outline – This is where your hand, eye or body outline is picked up and seamlessly ‘merged’ with the virtual elements. Simple example where you can pick up a 3D object that doesn’t exist because the system is tracking your hand outline.
4. Location – Based on detailed GPS or triangulation location & position/view of the camera/device the AR system can overlay information precisely over buildings or people as you move through real space.
5. Hologram – Using ‘smoke & spinning mirrors’ literally in some cases, virtual or real items are ‘projected’ into the physical space you are in and can be interactive with based on cameras tracking real world impulses e.g: hand gestures or audio signals

Before the more detailed list I embed my summary flickr chart whose purpose is to try to categorise types of business orientated augmented reality apps so to identify opportunities. The graph places 16 on axes of commercial value (likely revenue or marketing potential) vs adoption (scale of popularity vs a niche, client user base). It is a starting document to aid classification of this emerging commercial sector that I hope you find useful. The AR types, color key linked to each model is suggestive only. (Click on image for enlargement over at my flickr pages)

Below are longer descriptions of my top 16 Business Applications/Models for Augmented Reality and I suspect I will develop twenty more before the day is out! I have tried to break up some of the big AR areas such as ‘locative AR’ and separated them into several opportunities. This is an exercise looking at the marketing or commercial ‘intention’ vs a traditional pure business model, broad approach. It is a starting document to aid classification of an emerging commercial sector that I hope you find useful.

1. IN SITU: Aiding sale by seeing projects & products placed in the environment before completion. The benefit of a customer or client seeing a finished project, before it is complete. For example 1) real estate agents can scan and show an empty house full of stylish furniture or 2) an architect who can show the billion dollar client the skyscraper as a model perfectly aligned with the other buildings on the empty site and 3) Customers who want to see what the clothes look like on ‘them’ (as in the Zugara video above and Cisco below). The list of applications goes on.
2. UTILITY: Selling life enhancing AR applications perceived as useful. Development and commercial sale of applications such as underground train orientation, bus stops & times, traffic alerts, airport gates & plane arrivals etc: all overlaid in real space. Sometimes called AR browsers as they cross reference what or who you are looking at with anything or everything off the web or like this UPS example allows you to see if your ‘stuff’ will fit the ‘virtual’ postal boxes.
3. TRAINING: Hands-on with complex equipment and work scenarios. Using ‘outline’ recognition this allows us to be virtually ‘hands-on’ with complex equipment in difficult-to-practise work scenarios. Bomb disposal, surgery, flight simulation. . Indeed according to wikipedia the actual phrase Augmented Reality was coined by Tom Caudell in 1992 while at Boeing where workers trained to wire aircraft on AR systems. A massive industry for the developer community charging b2b rates.
4. SOCIAL GAMING: Both connotations of the word, pay-per-play mixed reality games in physical space. The potential to run pay per play (e.g: virtual paintball style) games in physical location and also live connected betting on sports or other competitive play – e.g: You point your iPhone at the horse and wirelessly place a bet – mid race! (odds adjusted of course) or using basic surface AR you play with others in a new kind of ‘games’ room!
5. LOCATION LAYERS: Blended guides to new places, tourism, enhanced travelling or themed space. For travellers just arrived at your city, theme park or other experience you can provide them with pay for tools that will help them take the most ‘mutually beneficial’ route after they arrive. Free data from wikipedia, local bloggers or more commercial entities add depth.
6. VIRTUAL DEMO: Display to promote sale, of product in pre-release or remotely via catalogue etc: To promote advance sales before the consumer gismo hits the stores, an AR display or the device/s so potential customers can manipulate it, see it from all sides, even customise the order. We may see future stores displaying the majority of items on the shop floor as AR while the item is shipped to your house before you get home! The reverse of this, an AR catalogue (as in the Ikea video below) that pops up models to help you build or see the product in 3D.
7. EXPERIENTIAL EDUCATION: Pay-per-visit educational services to museums, ancient sites etc: Pay-per-visit (ppv) to visit highly experiential museums, theme parks, zoos, ancient sites or exhibitions but with a higher purpose of providing deeper levels of information & visual sense than a simple plague or hard to follow guide book ever will. The sleepy animals in the zoo come to life, the ancient fossil is animated into an overlaid Google Earth, the Battle is enacted ‘on the original battlefield.
8. ENHANCED CLASSIFIEDS: An AR directory that promotes local 3rd parties product & services overlaid at the location. One of the obvious apps where someone in a city or town looking for a specific item could be ‘guided’ to it. A very affiliate model where the company that owns the Augmented Reality listing mechanism will take a slice of any fulfilled sales. A lot more to this of course.
9. 3D VIRALS: Branded company or personal promotion & ads using ‘cool’ 3D toys. Pattern based 3D model that entertains and is spread virally. The YouTube moment as a million links to cool ‘3D stuff’ that takes place next to you. Already we see some AR apps that allow you to record scenes of you interacting with said ‘3D viral’ and pass those around too, titillation, quirky giveaways– JibJab-type, put ‘you’ in the cartoon but revered, they are with you in 3D space.
10. PERSONALIZED SHOPPING: Walking around stores made relevant, opt in personalization and targeting. The oft mentioned Minority Report example. But in the pulled model, here you can deliver information to potential customers scanning stores, streets or shelves for discounted or personally relevant products.
11. COOPERATION: Service industry for augmented virtual meetings. We are all familiar with video conferencing, a few have dabbled in 3D virtual world get togethers but AR meetings are a game changer. The potential here using ‘discrete’ personal screens is to have the inevitable remote meeting with live feeds of your colleagues, blended into your room – pay-per-ARmeet
12. BLENDED BRANDING: The equivalent of hoardings, virtual poster ads. Once given a reason to be scanning outdoor areas with their AR devices the potential to deliver topical, timely and relevant ads or branding into the scene. Again care must be taken as AR spam (like social network spam) will quickly irritate, but like free to air TV, using various sponsored or freemium biz models will mean a certain amount of branding will be acceptable.
13. AUGMENTED EVENTS: Pay-per-use of enhanced sport or pop concerts. At live events spectators can pay and then scan their view of the ‘match’ for the latest information on sporting achievement or pop star gossip and of course tracking trails or watching replays in situ, merged over say a static real sporting scene.
14. INTERTAINMENT: New form experiential TV and films. Following on from my ‘AR story’ post, we know people will pay a premium for a new kind of ‘film’ experience where you ‘live the experience’. How about one that plays out at ‘your’ place. Semi customised marker or location AR apps will layer Brad or Angie into your lounge, onto the coffee table or your ‘composited’ in real time into the latest Mixed Reality TV show. Combined with 3D viewing technology will make Blu-Ray seem so 18th century.
15. UNDERSTANDING SYSTEMS: Creating AR for internal or exploded views of complex objects. Primarily useful in training or helping sell something where physically taking it apart is not possible a view of a car or other complex object can be enhanced. Labels or even an exploded view in real time can help get the message across.
16. RECOGNITION & TARGETING: Pushing ‘relevance’ to outdoor consumers – facial recognition linked to online data. To be used with care! It will be interesting to see how privacy laws affect this but in a pushed model you could ‘scan’ visitors to your store, identify their faces, do background links to their ‘social networks’ followed by personal targeting while they are shopping. We all know this is going to happen!

Some examples:

CISCO’s future of shopping

BMW Future of Car repairs

Augmented Reality in Marketing and Sales

James Cameron’s Avatar – Augmented Reality Entertainment

IKEA’s Future Augmented Reality Catalogues

To finish a few lines that describe one of my presentations coming up that acts as a nice conclusion…

It has been called the future of social mobile networking, experiential marketing and entertainment, Augmented Reality is about to snowball. With hundreds of apps launching onto iPhones, Games Consoles, Advanced TV and your PC this new technology allows us to view our world in exciting new ways. Once the domain of science fiction or super computers this new technology, blending the real with virtual, is now literally in the hands of everyday consumers and business. Augmented Reality is simply using a camera with screen to layer rich media and information over ‘our’ real world, in real time so we can now scan and layer web info over products and people in the store or street and provide virtual, ‘in situ’ hands-on demonstrations and deliver the ultimate ‘guide’ to our complex physical world. Is AR the new 3D viral experiential marketing or another temporary fad?

Finally, finally for those interested here is my Augmented and Mixed Reality YouTube playlist if you have an hour or so to spare to view the current collection of 60 +

Tran-social-media-play [tran-soc-shuh-mee-dee-uh-pley] noun, verb

1 noun – a new form, a means of collaborative communication through play in constructed shared ‘media-rich’ environments

2 verb – taking part in game-like activity across and within online and offline social networks and media portals.

Can we truly create meaningful immersive media ‘experiences’ for others? Ones that last, are memorable, have impact & emotion and keeps the ‘experience players’ coming back for more? I am currently building services, working on papers and delivering courses on Experience Design and this post is a quick summation of some of the background thinking and good case studies.

Life is filled with so many exciting twists and turns. Hop off the straight and narrow whenever you can and take the winding paths. Experience the exhilaration of the view from the edge. Because the moments spent there, that take your breath away, are what make you feel truly alive. © 2000 Stacey Charter

Filmmakers and marketeers are clearly moving into #TranSocialMedia Play in a big way with a triple whammy at the moment of Star Trek, Terminator & Lost (fan) ARG’s and a raft of social media campaigns across other film and TV properties (some much better than others!). I have written about worlds immersion and cross-media design many times in the past but this post looks at the addition of social play into the mix – a permanent fixture.

Transocialmedia play design has historically been the domain of theme park builders, after dinner murder mystery writers, letterboxers or installation artistes – always based in the physical realm with the best examples reliant on group social interaction. But immersive play like this has also been with us since the first MMOGs social games inside fantasy environments and are another side of a triangle which also includes the new kid on the block (adolescent teenager) 2D social media. The main premise of the below diagram is simple – all encompassing transocialmedia design should be centered in the triangle and incorporate these three dominant forces. (there is a lot more to the diagram especially around hybrid services, but it will have to be another post)

TANGENT

A minor diversion but totally related to hybrid services, I was sent a tweet from Ms. NPRIL last night.

BettinaTizzy“Could Disney-Pixar’s 3D film up lift virtual worlds?” this blogger asks. http://tr.im/lEkm – What do you guys think of this? @GaryPHayes?

@BettinaTizzy Good 3D opens the door, inside? the anim film delivered as an auto story route in a home 3D engine where you can also explore!

The actual article was about exposing large numbers of non-gamers to 3D and whether this would turn them into ‘virtual world’ participants. But more than this I am always keen on drawing attention to media forms in collision and future looking mash-ups – as cinema becomes 3D and games engines become filmic (quality wise) why not deliver the film inside the game engine – not as cut cinematic 2D but the whole thing in 3D. You press play and the story arcs unfold around your avatar (perhaps your invisible perhaps your an extra – who knows!), voices play out from the characters and in some scenarios you can interact where the story makes sense. You as the film player can move around inside the environment the drama is taking place, certain action scenes you can jump inside characters and so on. That way from a screen entertainment point of view at least, you can also play/backchat with your social peers inside and around the story – now that would be an experience?. But this is really another whole post so I will continue…

BACK TO THE STORY

The ‘online distributed story’ courses to Directors and Foundation students at AFTRS often start with thinking about what is the nature of true meaningful collaborative play and what serves the story. What does one need to ‘create’ to turn passive story viewers into active story players? When we talk about play there are two key ‘spaces’ – within the screen and with-out the screen. Students already immersed in online 2D social space immediately don’t see the value of the social mediums – asking a fish to explain water. They soon see the potential though unlike many ‘non-social online’ creators who often try to merge crude old-school practise into fragile social media and like a bull in a china shop find it hard to engage. I use a variety of tools and exercises but the simple workshop template below helps story tellers plan and quickly understand two sides of the triangle – 2D social media and 3D online worlds.

But as we know screen media only tells part of the story which is why promotion agencies and enlightened storytellers alike are (to borrow from Dale’s Cone of Experience again) moving into memorable forms of contrived and direct purposeful experiences in the real world and realise that real stickiness will come from the activities at the bottom part of Dale’s Cone.

This is all leading to a few recent examples in the transocialmedia space – mostly campaign casestudies hence the marketing bias and hat tip to casemovies for some. The first is from 42 entertainment, demonstrating how to create purpose, community and elements of role play on massive scale as part of the lead up to the Dark Knight film last year.

Another major launch last year was for Halo 3 and as they were really promoting 3D virtual space it made sense that the unique elements of this transocialmedia offering (albeit low on the social side) was the creation of a large physical model to bring virtual into physical space and then promote the ‘memorial’ throughout urban environments. Halo 3 incidentally became the biggest entertainment launch of all time.

I often use these four simple levels of cross-media design that I wrote on wikipedia some years ago as a framework to differentiate using platforms as just distribution (CM1) at one end to a seamless contiguous experience at the other (CM4). The fan created Star Trek Alternate Reality Game linear summary of a typical user journey, certainly adheres to the description CM4 ‘experience’ and goes where other ARGs have not gone before!

Cross-media 1.0 – Push. Minor variations of the same content placed on different platforms. E.g.: A slight re-edit of the audio for podcast or a transcript diced and sliced for a making of type website and more of now, watch the TV show on the TV, web or the DVB-H or 3G mobile phone or an iPod video download.

Cross-media 2.0 – Extras. Content that is already being produced but not destined to be delivered and repackaged onto other platforms so it appeared to be ‘original’ or at least specially created. More about the wonders of a good content management system than the true potential of cross-media.

Cross-media 3.0 – Bridges. Where most innovative 360 thinking is currently rooted – where the content placed on the other platform is critical to staying in touch with the narrative or service.The narratives tease you towards investigating or moving (via a bridge) to another media form/platform.

Cross-media 4.0 – Experience. To some extent this is producer ‘hands-off’- in that they have created an environment, much like a game, that the participant/s ‘lives’ inside of, following their own path, personalizing the experience. A cross-media 4.0 property is at its height a creation, a collaboration with the audience across many devices, which evolves and grows a life of its own.

As an interlude, an example that only uses two sides of the triangle that I had to include which demonstrates the power of a contrived, controlled physical event that then massively propagates across 2D social media – yes it’s Antwerp Train Station does Sound of Music.

An example of traditional ARG design that fails to use two sides of the transocialmedia triangle and will get lost in the noise is the rather stalled Skynet series of videos that were being used to launch the new Terminator movie. It does have an interesting Twitter element at http://twitter.com/skynetresearch that is now spilling out into Facebook and beyond – worth keeping an eye on. “Skynet Research is dedicated to eliminating human error.”

I had to add this example for two reasons. It is very clever marketing first and foremost morphing the meaning of a basic food product into one of the scariest browser ‘environments’ on the web – also it combined the two sides of the triangle 2D social and 3D world by creating the browser world – Hotel 626 as real horror experience. Many users were actually too terrified to explore this space – not bad for Dorritos!

Transocialmedia play design is still in its infancy as all sides of the triangle above evolve. Social networking is constantly moving towards being more real time as twitter growth demonstrates. 3D worlds are becoming much more integrated with real and 2D social space as well as becoming a far more ‘representative renderl’ of the real world which itself is being invaded with highly sophisticated mobile and pervasive computing devices. The real challenge at the moment is avoiding gimmick and surface superficiality but developing deep well threaded stories that afford a deeper more investigative engagement. I have noted the design of recent ‘media plays’ to be rather linear, find clue A that leads to clue B and so on vs much more non-linear quest. Many also fall into being over authored, complete and don’t allow contribution or collaboration (although that will happen regardless somewhere else if you haven’t allowed for it). One of the biggest challenges is to mature the form.

There are many who see transocialmedia play as purely marketing, there to sit on the coat tails of existing well known brands (such as AI, Halo, MacDonalds/Olympics) vs being of themselves for themselves. Admittedly there are a few of these scattered around but the player base is usually much lower. To finish a small, mini ARG transocialmedia play I designed last year called the Old Forest – which had a good mix of 3D mashed with physical world and a team social component. The story was fictional, looking at witches, spells and fires – you can find more detail about this and other mARGS on the Laboratory for Advanced Media Production wiki.

There was a rather sad epitaph to this mARG as exactly a year later the whole town of Marysville was tragically burnt with great loss of life in the worst Bushfires in Australia’s history. Truth is far stranger than fiction.

Appendix

For reference here is a abridge copy/paste from a post on an immersion post from 2006 – looking at the factors that enable immersive experiences.

SCALE – of the experience. The size of the screen and the amount of story world to explore has enormous impacts on immersion – as well as the detail of individual objects within the ‘world’. One of the reasons cinema will exist for a long time is that the large dark room filled with people is a captivating environment. Now, imagine a cinema where the image is a locked off-shot, of a shared world and all the audience are controlling and representing different characters engaged in a common goal or story. Ummm.

SENSES – goes without sayiing that the amount of senses that are engaged by an experience gives it most potential to immerse. Now as I have said before we dont need to consider full immersive reality rather make sure as well as intellectual and emotional engagement you consider sounds and the grammar of visual. Probably forget about touch, taste or smell for the moment – leave that to the porn industry to work out.

SERENDIPITY – how the world or show you are watching has elements of surprise. As mentioned earlier the more scripted and formulaic the less immersive. People only watch a film for the fifteenth time, I believe, because they strangely hope that there may be something different OR they are peeling back the layers, looking at minute detail and looking way beyond the basic narrative.

STORY – does the narrative engage. This is obvious, if there is nothing for you to be drawn along by (even your own story in some cases) then you will switch off.

PERSONALIZATION – Hence the title of this blog. How much can you minutely affect the world and yourself in it? How much will the world reflect you for being there? Most importantly, how much of your real world personality can you bring with you into the experience.

RESONANCE/CHOICE – How much control or agency do you have over the experience? Are your actions permanent and seen by all? Can you really do and say what you want – freedom of choice. True resonance is like a virtuous circle, you do something and there is a response that forever changes the environment. Like real life. The pushed media of TV, radio, cinema has zero resonance, it all happens in your head. Which is why stories ‘have’ to be based on life’s shared drama. In truly interactive models your actions have impact and will reaction will take place.

TEMPORALITY – How real time does the experience feel? Scheduled TV never feels real time – the only successful shows in the future will be live events, music, sports, live news etc: Everything else has a dubious future in the scheduled world. MMORPGs feel real time when you are in them because of all of the above. Ones that have scheduled events or require you to invade or fight at a certain time are more about story than true immersion.

ESCAPISM – or ‘play’. This goes back to my earlier point about the reason for play and associated spirituality. Is it as much about escaping reality or constructing ideality?

Does the representational nature of these ‘experience’ worlds mean so much more subconciously than endless souless advertisements on TV, or another episode of a soap, or fomulaic hollywood film? Does selecting an identity that is impossible to achieve in real life become a most powerful addictive escape? I suspect all of the above. In terms of building ‘play’ – it should be as fun making it as doing it. I have mentioned before that sometimes authors of experience get so lost in the creation process they forget someone has to watch, play or take part in it! Then it is much weaker an experience.

Below are my slides, a little descriptive text below that and at the bottom of this post some deeper insight into SmallWorlds (given most of my readers probably know Habbo already? – If not, Why Not!? ). I included one slide from Jeff Brookes set looking at Hitwise’s stats on browser worlds and other sites in terms of session length which will no doubt raise a few eyebrows!

Virtual Worlds & Business: What’s The ROI?

Virtual worlds are maturing at a rapid rate and brands are realising there are valuable business opportunities within them. Whether the objective is engagement, research or brand presence, virtual worlds are proving to be a legitimate marketing channel. In this session our panel will look to provide insights into the business benefits of working within a virtual world.

Presenters

• Gary Hayes, Director, Laboratory for Advanced Media Production, AFTRS & CEO MUVEDesign (Australia’s leading SL developer!)
• Jeff Brookes, Regional Director – Asia Pacific, Sulake Corporation (habbo.com.au)
• Mitch Olson, Co-Founder, SmallWorlds.com

There were several important messages in my introduction. Firstly making sure we all understand the different platforms social virtual worlds are operating on so I briefly described

1. Layered or Parallel worlds – cute 2D type avatars that move over the top of 2D web
2. Browser Worlds – walled garden that run inside web browsers, often as isometric views as flash or shockwave
3. Client Worlds – anything from 20MB to 3GB downloads of data and the world is obviously much richer than browser worlds but do need higher spec computers
4. Console Worlds – a relatively new kid on the block, social spaces that exist on games consoles. All the rendering grunt is there and the avatars are often linked to the PS3, Wii or XBox360 real life account. PS3 Home is the easiest way to match to worlds like Habbo or There.com
5. Note there are hybrids of the above and I would put ExitReality down as a hybrid of 1 and 3 as it turns a web page into a client style world

Here are the images of the above part of the presentation

I decided that a good ‘spine’ to hang the introduction on was the sort of negative questions floating around from those who don’t really understand what’s happening with web 3.0, the live virtual world space. This includes the paranoid printed press, a few out-of-touch businesses, and digital media companies/consultants more interested in iPhone/mobile games or Facebook widgets which is something they can truly explain (read: make money off).

Press hyperbole or myths?

• Virtual Worlds are on the decline?
• There’s no one in them?
• & people don’t spend long there?
• They are for kids or social ‘games’ not business?
• There are no marketing models?

But I then addressed each question in turn showing real world stats and examples. Obviously in recession investment in new tech/services are going to be hit and recent reports do suggest a consolidation of investment into kids worlds, hinting at a lowering of VC in the ones I highlighted in my presentation, but this whole area is still something education & business are advised to R&D and understand fully – as a minimum. As we know it will be new ways of doing business, more immersive and efficient ways to collaborate and alternate forms of entertainment that will be partly what will bring us out of recession.

I finished the talk with a quick overview of the main models that virtual worlds (and most online games) can be monetized. Items 1, 3 and 4 were picked up in a talk on the 2nd day of ad:tech looking at how Nike engaged with console ingame campaign experts Massive across a few platforms.

1. Static Advertising
2. Promotions & Sponsored events
3. Virtual Goods & Product Placement
4. Dynamic InWorld Advertising
5. Branded Spaces
6. AdverWorlds & AdverGames

After my talk some great examples from Jeff Brookes from Habbo followed by Mitch from Smallworlds. I am always fascinated by the methods Habbo engages with its loyal and large community and was equally fascinated by Small worlds thinking too and how they are ‘integrating’ themselves with the existing 2D social networked web. This video by the infamous Robert Scoble features Mitch Olsen and Ted of SmallWorlds

They talk about the main traditional world features but then go onto the interesting areas of embeddable worlds (the Google Lively Killer app – not exploited), API integration with almost anything (twitter feeds, YouTube vids, FB updates on walls anyone) and the most interesting ‘missions’. You are encouraged to explore, meet folk, shop and basically get involved – Mitch says this is like the LinkedIn profile thinking, until your profile is 100% filled in you feel like you are missing out. I likened it much more like World of Warcraft, set players tasks, set them group tasks, give them rewards. This to me could be SmallWorlds real killer applet. At the moment they have around 400 000 users and that looks set to take off in the next months.

Tony Fendall blogged about a particularly cute feature that allows (his words) -

One important thing which was missed is that they didn’t have time to talk about all the cool micropayment features (which Ted alludes near the end) such as Gambit, OfferPal and Zong. Gambit and OfferPal are both services which allow users to earn SmallWorlds currency by completing tasks. These tasks include things such as answering surveys and give amounts of currency proportional to the amount of effort put in. This is a great way for players (who may not have a credit card) to still be able to earn a premium SmallWorlds experience. Zong is a simple cell phone payment service, where by users can pay for a premium SmallWorlds experience using their mobile phone. For an excellent look at how we have integrated Zong into SmallWorlds, check out this YouTube video created by the developers at Zong:

Note a cross post from Gary’s other main blog personalizemedia

1. The Actual Audience – who they are, what their demo and psychographics are
2. The Market – dominant players, investment, in world currency and evident holes in the marketplace
3. Some key case studies – what has worked, how things could be improved and
4. A little bit about branded entertainment futures and how Virtual worlds will be more ‘merged’ with TV, film and the 2D social web.

Case studies included Best Buy, McDonalds, Nivea (Splinter Cell), MTV There, STA Travel, Fosters, Accenture, ABC, Intel, Jeep, Dodge, Habbo, Big Brother, Kelly Services, Gossip Girl, L Word, Football Superstars, Webkinz, Barbie Girls, Stardolls, BBC, blast theory,virtual office, club penguin, vside, little big planet, weblin, rocketon, imvu, ps3 home, second life (various including The Pond)
There are more presentations under the LAMP & Project Factory umbrella across social media, new form entertainment and virtual worlds at Gary’s slideshare account.

Details from the program
A detailed presentation given at the Online Social Networking and Business Collaboration conference in Sydney in November 2008 – on how to engage with shared social worlds – this includes locative games as well as traditional online game worlds and social 3D web based worlds. Specific focus on the networking elements and how this dictates the types of advertising and collaborative marketing.

Digital Worlds: Social, Virtual, Mobile
• Meet generation V
• What are the opportunities for enterprise, marketers and government?
• The psychological implications of virtual interaction
• What are the mobility limitations of virtual worlds?
Gary Hayes, Director LAMP, Head of Virtual Worlds, MUVEDesign
Laurel Papworth, Director & Social Networks Strategist,
World Communities

The video below is quick & cheerful, one-take, ‘Space Navigator’ Machinima and Music by Gary and the whole work was very similar in style and form to Thursday’s Fictions in Second Life, a MUVEDesigned project two years ago. Full credits for the Macbeth project below.

Macbeth in Second Life Credits
Guide & credits here

SLURL – http://slurl.com/secondlife/Macbeth/44/54/54

A collaboration by Angela Thomas, Kate Richards and Kerreen Ely-Harper, from an original idea by Kerreen Ely-Harper.
Producer: Kate RIchards (Nini Dubrovna)
Director: Kereen Ely-Harper (Dorothy Porta)
Virtual World Content Designer: Angela Thomas (Anya Ixchel)
SL Design Consultant: Adam Nash (Adam Ramona)

This project has been assisted by the Australian Government through the Australia Council, its arts funding and advisory body. Initial stages of this project were mentored and developed through the Laboratory for Advanced Media Production (LAMP) at Australian Film TV and Radio School (AFTRS). This project has been funded and built by the New Media Consortium

NMC Team:
Larry Johnson (Larry Pixel)
Alan Levine (CDB Barkley)
Rachel Smith (Ninmah Ash)
NMC Second Life Building Team:
Chris Holden (CJ Carnot)
Beth Satchjen (Stella Costello)

Voiceover Actors:
Maggie Blinco
Boris Brkic
Christopher Morris
Ophelia Of The Spirits
Alice Parkinson
Evelyn Parsonage
Recorded at Megaphone Studios
Engineer: Shane Fahey

Additional thanks to:
Larry Johnson
Therese Fingelton
Gary Hayes
Jeff Wegener
Ian Waddely
Nick Noakes

Filmed and edited by Gary Hayes of MUVEDesign. Note: This film does not demonstrate the many interactive elements, social intentions or literary integration. Please visit the island to see those first ‘virtual’ hand. A medium resolution (98MB MP4) download is available here

75MB MP4 Download available at http://www.justvirtual.com/SVWS_2008.mp4

A few immediate things that struck me on my travels:

• That there are quite a few worlds now getting their balance on the shoulders of Second Life and really getting to grips with the social networking aspects vs the 3D’ness
• There IS a balance between a social space and an ‘agreed’ advertorial world – “you give me valid experience, I accept a level of advertising”
• A few new entrants realise that using a fully fledged, 3D game engine as the client for what is in the end a glamorous 3D facebook and requiring a high spec’d PC is not the best way. Second generation services like vSide have followed a good middle ground
• As I reported a few days ago the ‘layered-over-the-2d-web’ version of these worlds such as RocketOn Exit Reality and Weblin show great usability and promise
• Some worlds are demonstrating the precursor to photo realism and smooth motion while others have as much ‘immersion’ by providing intimacy with your friends in more cutesy environments
• Many of these worlds operate without the hype we have seen with Second Life and have slowly been building up large communities. Beware any world that tries to launch on hype, as most of these worlds are still in adolescence and not ready for mainstream
• The Metaverse is a world of connected worlds, how/when/if they are connected will be a real challenge from a technical and standardisation perspective. Especially as a few are starting to concentrate on themes, music, sport and probably in the end very defined niches – fly fishing social world anyone?
• It is important for those who are supposedly representing or blogging about ‘the metaverse’ to get in there and try these services – beyond registering and wandering around for only 10 minutes (I could name several who haven’t a clue!) but…
• There are not enough hours in the day to attempt to truly engage with each world but it is amazing how adept you become at spotting flaws and innovation when you put the effort in
• lots more to follow from the official report in a future post…

KZero are turning out to be the best resource on the planet, tracking Social Virtual Worlds and their latent potential. They gave me permission to publish/post this great chart with a great stab at putting many of the worlds in the video across content sectors.

Here is a list of the worlds featured in my video in order of appearance:

• Kaneva
• YoVille (in Facebook)
• RocketOn
• Prototerra
• Gaia Online
• HiPiHi
• Google Lively
• Habbo Hotel
• Laguna Beach (vMTV)
• Whyville
• Twinity
• Cyworld
• Football Superstars
• Weblin
• IMVU
• Second Life
• Club Penguin
• Active Worlds
• vSide
• A Tale in the Desert
• Barbie Online
• Amazing Worlds
• Webkinz
• Worlds.com
• Spore
• Exit Reality
• and 15 others including SpineWorld, Stardoll, The Manor, There.com, Vastpark, Qwaq, PS3Home, GoSupermodel, Grockit, Croquet, Metaplace, Coke Studios, Dreamville, Dubit, Mokitown, Moove, Muse, The Palace, Playdo, Sora City, Voodoo Chat, TowerChat, Traveler, Virtual Ibiza

Social Virtual Worlds Logos

Video details:

The ‘Social Virtual’ World’s A Stage
A Film by Gary Hayes © MUVEDesign/Personalizemedia 2008

“This is not a Game” – Music composed and performed by
Gary Hayes http://www.korkyt.net

A video insight into the build process of the new Deakin Arts Education Centre Island built and designed by MUVEDesign’s Gary Hayes completed early 2008.

Jenny Grenfell, Arts Lecturer at Deakin said:

“This Deakin University Arts Education community in Second Life aims to stir the imagination. It is a world we create and create within. It is at once a work of art and a place to inspire, make, share and present art. Our presence in SL is both for performance and is in itself a performance.

Our Second Life existence is an extension of our involvement in the real world where we are passionately immersed in the practices of teaching and learning in our art forms of visual art, drama, music, dance, and media.”

Medium rez 105MB MP4 available here. Music composed and performed by Gary Hayes. These images with comments can be seen here.

Video, music & 447 Images © Gary Hayes and Deakin University

Below is the flickr slideshow embedded as an alternative

I have been doing a lot of work moving brands, properties and companies into Second Life recently and in the process I am often forcibly reminded of the divide that naturally exists, in these new worlds, between ‘the corporation’ on one hand and ‘the individual/community’ on the other. The 3D Virtual World is being used in many ways by the natives (aka the public, a bad definition I know), living out their fantasies in a very chaotic but social way. In strong contrast to that we have companies who are naturally bland, characterless, faceless and in the worse cases anti-social.

It is not all bad as we are seeing something very positive emerging and being played out as both sides manouver and become better aligned. We are also seeing the next phase as the early mistakes pull out and leave the new entrants to learn from those errors. So I have collected some of my thoughts below on how companies need to approach the development of their personality.

First though let me explain the title of this piece with two simple examples. I was struck, like many by the documentary film ‘The Corporation‘ which began by explaining at great lengths how similar the actions of large organisations (if they were looked at as an individual) are psychopathic in nature. I quote the definition they use as the basis to extemporize and a taste of that from Mr Monks.:

PERSONALITY DIAGNOSTIC CHECKLIST:
World Health Organization ICD-10. Manual of Mental Disorders DSM-IV
- Incapacity to maintain enduring relationships
- Deceitfulness: repeated lying and conning others for profit
- Incapacity to experience guilt
- Failure to conform to social norms with respect to lawful behavior
- Callous unconcern for the feelings of others
snip…

“A corporation is an externalizing machine in the same way that a shark is a killing machine. Each one is designed in a very efficient way, to accomplish particular objectives. In the achievement of those objectives, there isn’t any question of malevolence or of will, the enterprise has within it, and the shark has within it, those characteristics that enable it to do that for which it was designed.” Robert Monks, Corporate governance advisor

Of course I am being deliberately provocative in stating this but in the context of an immersive fully rendered world there is a high degree of potential for levels of the above to continue unabated. If a slightly anachistic documentary is not to your taste then the second one will hopefully clarify. “Hello I’m a Mac and I’m a PC” – or translated “Hello I’m Apple and I’m Microsoft (Windows)”. We all know what that series of ads is really saying and it leads into the main part of my post nicely. The PC character in those ads represents dysfunctionality (mild pyschopathy), corporate stubborness, overweight, bad eyes and old school ‘tech’ thinking, whereas the cool Apple dude represents the opposites – friendly, balanced, youthful, innovative and even understanding of PC. Those ads are great fun but they become very serious for the corporations when you start to consider the inhabitants partying in Virtual Worlds deciding which one would to hang-out with. Commercial organisations need to have character and an indentifiable personality in the metaverse and cannot rely anymore on corporate slickness, blandness or aloofness. To engage with audiences and inhabitants in these spaces they need to learn how to be human.

So I have collected for all those corporations out there wondering how to accepted in the 3D and for that matter the 2D social network, my top tips for those thinking of jumping in or those who are wondering why things are not going right.

One: Understand the Culture by Spending Time There
Make sure you have people who know the culture of the world and who have spent enough quality time inworld across the whole gamut of experience. Do not rely on reports from tourist consultants, so-called emerging media experts who can see an opportunity and sell themselves as folk who know about the world and who may have set up an account and visited it on a few odd occasions. Ask them how long per week they personally use the social network. If it is 10-20 hours then keep talking, if they pop in for 10 minutes a day when they are not busy or taking the kids to school then give them a miss – you will get better advice by going inworld yourself and talking to experienced inhabitants. Also make sure the people who you employ to represent you inworld are extremely familiar not just with the local space they will be hanging around in but the whole social world. Make sure they have a passion for it and are not being forced to go in there – so they can talk to inhabitants about other spaces from experience. This will engender trust and more importantly friendship.

Two: Be A Part of the Conversation
It goes without saying that you have to be in it to really be in it. Corps can’t sit on the sidelines or be the obligatory wall flower, spying on others at the party. They have to be in there talking, befriending and listening. Just being present is not enough to integrate properly. I have seen many companies entering a space who don’t join or setup groups, never go to other events and meet others which is odd given this is a social network – no different to those dive bar, industry get-togethers in the real world. Finding someone who is passionate in your organisation and who can then commit time is the only way to go. Don’t become the officious big brother, watch-dog. With the advent of voice in Second Life new factors come into play of course. Your company representatives are in there having real time phone conferencing in effect with anyone and everyone who decides to drop in. Think carefully about the things you need to say vs those that will endear you to the community. It makes a lot more sense to talk about the shared experience than saying how wonderful your company is. Organise specific events where you will be expected to talk about the brand vs trying to constantly slip it into social discussion.

Three: You Are What Your Environment IS
Just as we can tell an individual from the places they visit or the state of their work and social rooms, the same holds true of companies. Your corporate personality is reflected in the spaces you build. If you look at the native environments vs the corporate ones in the metaverse you can see a world of difference. The commercial ones are often built by a team which has been steered by many, many meetings that have sand-papered away all the risk and character. They end up being designed by committee and as such are not resonant with anyone – apart from the corporate lawyers who can only see ‘safe’. Whereas an organic, rich, deep welcoming space has the opposite effect. I have talked for two years about over representation too. If you build a clone of your office, complex or city you are stating two things – 1) corporate vanity and 2) lack of innovation. You should take a certain level of risk by creating environments that engage before they try to impress or show business control.

Four: Corporate Avatars Need to have Character
This is a critical point in how to be human in these spaces. Have avatars that have a personality, meaning make sure the person on the other side of the avatar is not some bland company customer relations person who can only talk about the business parrot style. This is the opportunity for your company to really shine and show a different side to herself. Oh yes the lawyers will be screaming ‘disclaimer’ from the rooftops. Well fine go for it and to be literal, have a permanent sign on your t-shirt with the obligatory “the views I express are mine and not that of…” and so on – not suggesting you do that precisely, but you get the point. A community will only start to connect when ‘company’ characters are present. Think of the Virgin empire. They shout personality, that youthful exuberance, those Branson clones – allowing the person inside to come out. They are sadly let down by having to wear the uniform but in these environments you don’t have to be the photo-realistic clone of your real self. Do what the natives do and be imaginative with your representation and the words you deliver.

Five: Listen, Listen, Listen and Respond
Corporations find it hard to respond because anything of significance has to be rubber stamped by people that all too often have no idea what it really means. “All the inhabitants want SkyDiving competitions every Sunday” – passed to the lawyers who spend weeks working out the liability aspects of that, what if someone gets injured can they sue – until someone chirps up “actually no one can be harmed” and even then they look into psychological torture. By this time the residents are already running competitions on their own land or with a more responsive competitor. Another aspect of listening is not pushing. Too many corporations think that if they blog or stand in the crowd and talk then they are mixing with the web 2-3 communty. They are not – they are pushing it one way and unable to listen to the replies and respond. They become an incarnation of traditional broadcast media. A simple rule here – Do Not Talk in the Community Unless you have the Mechanisms to Respond. Sadly so many corporations just don’t respond to suggestions or in the worst cases do not even acknowledge. This is the most disenfranchising thing there is for someone who is starting to want to make things better, to be ignored by the administrators. This requires some sensitivity at the admin level, which is often lacking if they are hired help or jaded managers.

Six: Rich Kids Shouldn’t Copy
Every ‘expert’ in marketing in Second Life say bring something of value to the community – which can only be defined if you know the world. It may already be there. But even more important is to bring relevance and something new. It is OK initially showing off like the rich kid with some wonderful interactive toys you have bought or giving lots of ‘branded’ things away but you need to go way beyond that. Do something completely different and potentially on a grand scale. The advantage you as the corporation have over the natives is that you really are the rich kid on the block. So don’t set up a tiny cool drinks dispenser, or a shop sized office or a beach resort – be bold and consider multiple islands that offer rich immersive experiences (see previous post on this). You can still be rich and relate to the community – give them places to tell new stories. Too many times I hear “Oh yes the new CorpX sim is OK, the usual shops, club, offices but bit boring and here is the baseball cap – detach”. Offer things that fit with your brand but doesn’t contradict it – become almost like a friendly, approachable benefactor. Also be wary of just buying things that many may have experienced already. Plagiarism is rife in social virtual worlds because of the scale, most people are not expected to get around that much so there is a certain complacency that corporations think that as they are bigger than the others kids, they can ‘nick’ the idea. The community is very sensitive to this. Corporations without imagination are just rich kids, not imaginative rich kids.

Seven: Be Consistent and Beware of Real World Journalism
Authenticity is about being consistent and not schizophrenic. You will find it hard to survive if you are having conversations in these social networks as one persona then in the real world a journalist requests an interview in which you talk about the community as folk to be manipulated. Most Second Life journalists understand this and will often do interviews inworld, the ones to be aware of are the attention seeking real world journalists who are after something sensationalist to prop up their dwindling traffic rating. Most of these haven’t the slightest idea about integrating into social networks (apart from their own) and will not print anything to do with ‘Corporation Working Well with Community’ stories – they want ‘Community Griefers Attack Corporation’ ones, they sell. Keep well away from that kind of fiction.

But consistency of persona is hard to do across the many social networks as many are abstract (in other words, the 2D, non-real time facebook are a series of panes that supposedly make up who you are) – in the metaverse it is extremely close to real life. What you say, do and who you relate to give real time feedback to those around about who you really are – corporate robot or passionate person. Inhabitants like to come back to places where the ‘general’ experience is known. If they enjoyed it once when they come back they don’t want a different character in charge who is dull or uninterested in them. This requires great effort on the part of the corporation to set a style of interaction with its visitors which must be kept consistent.

Eight: Do What the Natives Want
Social Virtual Worlds like Second Life and Sony Home are mostly about shopping, media based activities, lifestyle emulation and socialising. As a corporation or brand sitting on top of, or rather inside an existing companies infrastructure you need to be careful to not do what everyone is already doing. There is an attraction in setting up an environment and then setup rental land for homes and shops because that is what inhabitants seem to want. But that says more about the social network than you bringing something to it. It also pangs a little of laziness and doing something tried and tested. The natives also love to make things (well 30% in Second Life) so be really active in encouraging and rewarding that. Get them to design and build your branded play area with you.

Nine: Keep Reinventing Yourself and be Fresh
Remain consistent in character but always have new things happening to show how dynamic you are. Don’t limit it to dances, music concerts or presentations (in SL you can get these everywhere) but go down to the level of environmental decoration, the signs, subtle changes to the spaces and tell people about those changes. But the most critical element of being dynamic is to listen to suggestions from your visitors, do changes on the spot and even do personal fit outs for the loyal inhabitants of your space. Many organisations fail in Second Life by launching with something which then sits there and decays (with no updates). People get bored with people that don’t change and will drift away for new pastures. Invite suggestions for change but always have the resources within your organisation and with your developers (who will often know a lot more than you – having time to spend inworld) to do regular facelifts.

Ten: Share Your Assets and The Paradox of Risk Aversion
Inhabitants of your space will feel more inclined to stay if you provide them with some chance to own parts of it through the opportunity to affect it. Think of this as the rich kid who invites the world onto their mansion grounds for a party. Do not be the party host that goes around sweeping up every time someone drops a few crumbs, they will not return. Instead accept a certain amount of chaos and allow them to influence and have a sense of ownership. You will get more respect for empowering them and allowing an element of free reign. But so many companies are terrified of ending up with egg on their face through griefing or being sued for some copyright infringement that they lock everything down. This just says you as an individual are controlled by lawyers, who cannot express their own mind who as we know are the worst folks to have in any social group.

Eleven: Don’t Always Try to Be the Centre of Attention
Companies that expect their ‘characters’ to be in control and always leading the conversation will be seen as anything from show off through to bully. Social networks are democratic, your brand is as important to the inhabitants as their own identity or groups they belong to. Do not metaphorically walk into a crowd and pronounce your self-imposed importance, this jars with the whole premise of social networks.

Twelve: Story Environments
By all means create spaces that are really great to hang out in for long periods of time but also try to give the place some history and depth. When your not around you need the evnironment to speak for you by speaking, literally in some cases, with the visitors. So embed or write some history into it, create some myth, make it feel like you have been around for a bit. This depth is attractive to those visiting. See my wikipedia article on this topic here which covers ways you can give yourself (represented by the environment) some back story and depth.

Thirteen: Help create a Trusted Community
If you have followed some of the above advice then you will start to become the space to be, full of character, innovation and depth. As the traffic increases you just wont be able to manage it all by yourself and tensions can result. It is not a bad thing for the company characters to fly off the handle occasionally because of being over stretched with requests, endless IMs and so on – it shows they are human. But this is also a warning sign to start to create tiers of help within the community, namely the most loyal and immersed inhabitants themselves. Give them limited powers but ones that has enough responsibility to make them feel empowered. Set rules up for them that are part of a discussion as to the best ways to operate. If they make mistakes do not slap their wrists, change the framework of how they can operate. Of course the lawyers kick in again here with non-employee representatives (many of whom may not be know in the real world) – but again that wonderful disclaimer can be pulled out of the hat. To think you can manage without community support at admin levels means you will be over stretched as a person corporation, become stressed and in the end find it more comfortable to not be in there in the first place – contrary to all the above.

Fourteen: Entertain
It is fine being a wonderful administrator and organiser but you will be looked on to provide entertainment sometimes. You can’t expect your community to just do it all the time. You need to step in on a regular basis to show that you can put on big events. This encourages the relationship and more importantly suggestions as to how to make the events and activities better or develop new ones.

Fifteen: Don’t Listen to Too Much Advice
I would recommend listening to advice from trusted developers who have a track record for creating really good social spaces and not listening to out of world consultants. But in the end go with your gut reaction based on your personal experiences about what you think fulfills the needs of existing inhabitants in these 3D social networks. Having a genuine approach will most likely create a genuine response from your potential community. Remember though at the start you are a tourist and as such not doing anything until you are ready makes the most sense.

Gary Hayes is the Head of Virtual Worlds for the Project Factory and Director of the Laboratory for Advanced Media Production, LAMP. He personally produced and built the top brand in SL Telstra’s ‘The Pond’ and ABC TV (top ten) in several statistics (New World Notes and TPF) over the past 6 months. Recent other launches include Thursday’s Fictions and Melbourne Laneways.

Posted by Gary Hayes © 2007 All Rights Reserved.