1. At the TV Show Australia next week he is presenting about Social Television now and in the near future and how Inspiring the stories of tomorrow with social mediawill make TV truly and finally interactive
   

   Santa Clara Convention Center

2. In Santa Clara, CA he is opening the business track by presenting New Augmented Reality Business Models at the worlds biggest Augmented Reality Conference known as the Event
3. And in June Gary is presenting at GameTech on Pervasive Entertainment and the exciting merging of Games, Film/TV, Geo-Caching and Social Media

Gary is also presenting at various adhoc conferences such as Creative Sydney here where he is MC’ing & presenting on various Transmedia & Multi-Platform Content sessions.

More details on each of these below and if you want to speak to us about how MUVEDesign can help you realise your projects in these areas look at our service area and contact us here.

‘Multi-Platform’ TV Show

Australia 2011 27-29 Apr Sydney

Day 2  2.10pm Inspiring the stories of tomorrow with social media

The Augmented Reality Event 2011

May 17-18 Santa Clara, CA, USA

The Augmented Reality Event 2011 will feature industry luminaries: Bruce Sterling, Vernor Vinge, Will Wright, and Blaise Aguera y Arcas. ARE 2011 will include more than 100(!) speakers in 30 sessions organized into 3 tracks: business, technology & programming, and production & design.

The 2 day event will feature more than 33 hours of talks running the gamut of AR essentials in 3 tracks: Business, Technology and Production:

1. Business – For executives of established and start-up AR companies, as well as mobile hardware companies – in search of business models and promising verticals for AR;  a venue to form partnerships, learn about latest innovations, and most importantly speak with clients.
2. Technology – For Developers, programmers and technologists seeking the latest and greatest engines and tools for AR; learn from case studies and post mortems delivered by experienced developers from the leading companies in the space.
3. Production – For Producers, designers, project managers (in gaming companies, agencies, marketers, brands, and artists) hungry for proven techniques to leverage augmented reality to advance your brand, attract and keep your customers, and build successful campaigns and products that will delight users.

Day One – Tuesday 17-May-2011

• 8:15-9:00 am ARE 2011 Press Conference  Moderated by Ryan Wagner Great America XK – First Floor. Opportunity for AR companies to announce new products with major tech media
• 9:00-9:45 am Keynote: Bruce Sterling Wired Main Theater
• 10:00-11:00 am AR Market: Today and Tomorrow Business Track  (Great America J – First Floor)
  • Gary Hayes (MUVEDesign)- New AR Business Models
  • Laurel Papworth (Community Crew) – Building Mobile AR Social Communities for Business

GameTech

21-22 June 2011 Sydney

Video games and interactive entertainment has come of age, and it’s serious business. Games have emerged as the pinnacle of consumer entertainment. The interactive entertainment industry is now faced with unprecedented popularity, unparalleled growth and significant opportunity.

“The global video gaming market is expected to grow at a CAG Rate of 8.9% to reach $76.1bn in 2013”*

The benefits of this are not just restricted to the video game developers and publishers- all areas of the value chain and the wider industry arereaping the rewards of this growth opportunity. As users are shifting towards new platforms developers and publishers are changing their business models to wrestle for market share.

• Gametech is a 2-day conference blitz of learning, inspiration, solutions, and networking. It is the most comprehensive event on games and interactive entertainment in the region, and will provide an unparalleled event experience.
• Gametech is for those who wish to benefit from the explosive growth in video gaming. Whether you are part of the industry value chain or whether you are considering interactive entertainment as a tool for your business.
• Gametech features visionary presentations, insightful case studies, lively debate and expert information on timely cutting-edge business topics of interactive entertainment and gaining from video gaming technology.

Gary’s is presenting on key areas of Merged Media and how Gamification is acritical component of all multi-platform content forms

1355 – Pervasive Entertainment – Games, Film, Music, Print & TV merging with audience networks

• Assessing the concept of Pervasive Entertainment and how it is affecting the games industry
• How are brands extending to transmedia?
• Reviewing the business models behind geo-social / augmented reality games
• Learning form relevant case studies
• What models of media production, distribution, and consumption are implied by these future
• visions of entertainment?

Gary Hayes, Director MUVEDesign & Founder StoryLabs

ROUNDTABLE 15.10 - Unleash the Power of Interactive Entertainment – Diversifying Your Product Offering with Video Games

• How has the appeal of video games widened to new audiences?
• Underlying the process of developing games to compliment existing products
• Is there a limit as to the nature of business capable of benefiting from games
• Finding the right monetization model to support a standalone games product
• Key ingredients for successful games for social media platforms
• How can games and interactive entertainment incorporate features such as user-generated content, sharing, rewards and referral programs?
• Key steps to monetize new social gaming environments?

Sam Doust Creative Director, Strategic Development
 ABC

David Peattie Managing Director
 Hasbro

Hugh Baldwin Director of Television and Content Acquisitions 
Nickelodeon, MTV

Gary Hayes Director MUVEDesign & Founder 
StoryLabs

APPLE SDK

We are registered iOS 4.1 developers with several apps coming out via the App store soon. We can also place paid apps through onto the store for clients

ANDROID SDK

We are part of the Android development community and can develop applications for android tablets and mobile devices and distribute into the Android market for clients

GEO LOCATION DEVELOPMENT

MUVEDesign are registered developers on both the Layar and Junaio location based browsers that work on Android and iPhad platforms. We can also develop Junaio Glue, marker or pattern based recognition

MARKER & IMAGE RECOGNITION AUGMENTED REALITY

We can develop simple AR marker webcam services using the industry standard Flash AR toolkit or utilise some of the latest technology such as Qualcomm’s Augmented Reality SDK which we are beta registered for

GAMES AND VIRTUAL WORLDS AND SOCIAL MEDIA

MUVEDesign can naturally build a range of social media sites such as WordPress/BuddyPress networks, Drupal or Joomla installs and is well known already as a key Second Life developer but also can create standalone games using software such as Unity – for iPhone, Web, Standalone Mac & PC and even Wii games.

But the purpose of this pretty detailed post is to simply list and try to categorise the many types of business Augmented Reality apps appearing in the market and to try to identify opportunities.

Augmented Reality Business by Gary Hayes

According to wikipedia, the first manifestations of AR appeared in the late 60s, became real in the 70s and by the 90s were already being used by major companies. Now portable computing is finally powerful enough to deliver AR to anyone who has a smart phone or latest generation PC or console. For those unfamiliar here is my simple definition of Augmented Reality.

Information, 3D models or live action blended with or overlaid onto the physical world around us, in real time. A camera & attached screen is used to view the combination of real world and metadata or rich media. Devices or systems commonly used for AR include:

• Mobile devices with inbuilt cameras such as iPhone, DS Lite, PSP or Android
• A head mounted display HMDs (eg: glasses or futuristic contact lenses) attached to a wearable networked computer
• A PC or Mac with webcam
• A games console with camera accessory
• A large TV screen with advanced Set Top box and Web cam
• Others in development

There will be hundreds of business, marketing and educational applications alongside the many 1st generation entertainment examples currently emerging. As usual the video game and porn industries are pioneering the research and development of the technology but we are about to see a plethora of more mundane utility & life enhancing applications about to swamp the market. Combine this with hundreds of space cadet ‘toys’ and viral fluff and we start to see the beginnings of a large industry. Of course the usual caveats apply but unlike say virtual worlds which suffered from too much early hype, these apps are much more accessible to anyone with a decent smart phone, up to date games console or computer with webcam – there is a big difference.

But before going onto my list (which is of course non-exhaustive) here are my basic types of Augmented Reality from a slightly technical perspective but which we can apply to commercial and marketing applications. My presentations and paper have much more detail with specific case studies of each.

GARY’S FIVE TECHNICAL TYPES OF AUGMENTED REALITY

1. Surface – The most understandable form of ‘reality that is augmented’ would be screens, floors, walls etc that respond to the touch of people in them providing them with virtual real time information or collaboration
2. Pattern – The AR system performs simple pattern recognition on a shape, marker (usually on a framed card in the real world scene) or face and replaces it with a static or moving element e.g: a 3D model, info, audio, video stream or loop etc: You view the ‘items’ in the scene with you
3. Outline – This is where your hand, eye or body outline is picked up and seamlessly ‘merged’ with the virtual elements. Simple example where you can pick up a 3D object that doesn’t exist because the system is tracking your hand outline.
4. Location – Based on detailed GPS or triangulation location & position/view of the camera/device the AR system can overlay information precisely over buildings or people as you move through real space.
5. Hologram – Using ‘smoke & spinning mirrors’ literally in some cases, virtual or real items are ‘projected’ into the physical space you are in and can be interactive with based on cameras tracking real world impulses e.g: hand gestures or audio signals

Before the more detailed list I embed my summary flickr chart whose purpose is to try to categorise types of business orientated augmented reality apps so to identify opportunities. The graph places 16 on axes of commercial value (likely revenue or marketing potential) vs adoption (scale of popularity vs a niche, client user base). It is a starting document to aid classification of this emerging commercial sector that I hope you find useful. The AR types, color key linked to each model is suggestive only. (Click on image for enlargement over at my flickr pages)

Below are longer descriptions of my top 16 Business Applications/Models for Augmented Reality and I suspect I will develop twenty more before the day is out! I have tried to break up some of the big AR areas such as ‘locative AR’ and separated them into several opportunities. This is an exercise looking at the marketing or commercial ‘intention’ vs a traditional pure business model, broad approach. It is a starting document to aid classification of an emerging commercial sector that I hope you find useful.

1. IN SITU: Aiding sale by seeing projects & products placed in the environment before completion. The benefit of a customer or client seeing a finished project, before it is complete. For example 1) real estate agents can scan and show an empty house full of stylish furniture or 2) an architect who can show the billion dollar client the skyscraper as a model perfectly aligned with the other buildings on the empty site and 3) Customers who want to see what the clothes look like on ‘them’ (as in the Zugara video above and Cisco below). The list of applications goes on.
2. UTILITY: Selling life enhancing AR applications perceived as useful. Development and commercial sale of applications such as underground train orientation, bus stops & times, traffic alerts, airport gates & plane arrivals etc: all overlaid in real space. Sometimes called AR browsers as they cross reference what or who you are looking at with anything or everything off the web or like this UPS example allows you to see if your ‘stuff’ will fit the ‘virtual’ postal boxes.
3. TRAINING: Hands-on with complex equipment and work scenarios. Using ‘outline’ recognition this allows us to be virtually ‘hands-on’ with complex equipment in difficult-to-practise work scenarios. Bomb disposal, surgery, flight simulation. . Indeed according to wikipedia the actual phrase Augmented Reality was coined by Tom Caudell in 1992 while at Boeing where workers trained to wire aircraft on AR systems. A massive industry for the developer community charging b2b rates.
4. SOCIAL GAMING: Both connotations of the word, pay-per-play mixed reality games in physical space. The potential to run pay per play (e.g: virtual paintball style) games in physical location and also live connected betting on sports or other competitive play – e.g: You point your iPhone at the horse and wirelessly place a bet – mid race! (odds adjusted of course) or using basic surface AR you play with others in a new kind of ‘games’ room!
5. LOCATION LAYERS: Blended guides to new places, tourism, enhanced travelling or themed space. For travellers just arrived at your city, theme park or other experience you can provide them with pay for tools that will help them take the most ‘mutually beneficial’ route after they arrive. Free data from wikipedia, local bloggers or more commercial entities add depth.
6. VIRTUAL DEMO: Display to promote sale, of product in pre-release or remotely via catalogue etc: To promote advance sales before the consumer gismo hits the stores, an AR display or the device/s so potential customers can manipulate it, see it from all sides, even customise the order. We may see future stores displaying the majority of items on the shop floor as AR while the item is shipped to your house before you get home! The reverse of this, an AR catalogue (as in the Ikea video below) that pops up models to help you build or see the product in 3D.
7. EXPERIENTIAL EDUCATION: Pay-per-visit educational services to museums, ancient sites etc: Pay-per-visit (ppv) to visit highly experiential museums, theme parks, zoos, ancient sites or exhibitions but with a higher purpose of providing deeper levels of information & visual sense than a simple plague or hard to follow guide book ever will. The sleepy animals in the zoo come to life, the ancient fossil is animated into an overlaid Google Earth, the Battle is enacted ‘on the original battlefield.
8. ENHANCED CLASSIFIEDS: An AR directory that promotes local 3rd parties product & services overlaid at the location. One of the obvious apps where someone in a city or town looking for a specific item could be ‘guided’ to it. A very affiliate model where the company that owns the Augmented Reality listing mechanism will take a slice of any fulfilled sales. A lot more to this of course.
9. 3D VIRALS: Branded company or personal promotion & ads using ‘cool’ 3D toys. Pattern based 3D model that entertains and is spread virally. The YouTube moment as a million links to cool ‘3D stuff’ that takes place next to you. Already we see some AR apps that allow you to record scenes of you interacting with said ‘3D viral’ and pass those around too, titillation, quirky giveaways– JibJab-type, put ‘you’ in the cartoon but revered, they are with you in 3D space.
10. PERSONALIZED SHOPPING: Walking around stores made relevant, opt in personalization and targeting. The oft mentioned Minority Report example. But in the pulled model, here you can deliver information to potential customers scanning stores, streets or shelves for discounted or personally relevant products.
11. COOPERATION: Service industry for augmented virtual meetings. We are all familiar with video conferencing, a few have dabbled in 3D virtual world get togethers but AR meetings are a game changer. The potential here using ‘discrete’ personal screens is to have the inevitable remote meeting with live feeds of your colleagues, blended into your room – pay-per-ARmeet
12. BLENDED BRANDING: The equivalent of hoardings, virtual poster ads. Once given a reason to be scanning outdoor areas with their AR devices the potential to deliver topical, timely and relevant ads or branding into the scene. Again care must be taken as AR spam (like social network spam) will quickly irritate, but like free to air TV, using various sponsored or freemium biz models will mean a certain amount of branding will be acceptable.
13. AUGMENTED EVENTS: Pay-per-use of enhanced sport or pop concerts. At live events spectators can pay and then scan their view of the ‘match’ for the latest information on sporting achievement or pop star gossip and of course tracking trails or watching replays in situ, merged over say a static real sporting scene.
14. INTERTAINMENT: New form experiential TV and films. Following on from my ‘AR story’ post, we know people will pay a premium for a new kind of ‘film’ experience where you ‘live the experience’. How about one that plays out at ‘your’ place. Semi customised marker or location AR apps will layer Brad or Angie into your lounge, onto the coffee table or your ‘composited’ in real time into the latest Mixed Reality TV show. Combined with 3D viewing technology will make Blu-Ray seem so 18th century.
15. UNDERSTANDING SYSTEMS: Creating AR for internal or exploded views of complex objects. Primarily useful in training or helping sell something where physically taking it apart is not possible a view of a car or other complex object can be enhanced. Labels or even an exploded view in real time can help get the message across.
16. RECOGNITION & TARGETING: Pushing ‘relevance’ to outdoor consumers – facial recognition linked to online data. To be used with care! It will be interesting to see how privacy laws affect this but in a pushed model you could ‘scan’ visitors to your store, identify their faces, do background links to their ‘social networks’ followed by personal targeting while they are shopping. We all know this is going to happen!

Some examples:

CISCO’s future of shopping

BMW Future of Car repairs

Augmented Reality in Marketing and Sales

James Cameron’s Avatar – Augmented Reality Entertainment

IKEA’s Future Augmented Reality Catalogues

To finish a few lines that describe one of my presentations coming up that acts as a nice conclusion…

It has been called the future of social mobile networking, experiential marketing and entertainment, Augmented Reality is about to snowball. With hundreds of apps launching onto iPhones, Games Consoles, Advanced TV and your PC this new technology allows us to view our world in exciting new ways. Once the domain of science fiction or super computers this new technology, blending the real with virtual, is now literally in the hands of everyday consumers and business. Augmented Reality is simply using a camera with screen to layer rich media and information over ‘our’ real world, in real time so we can now scan and layer web info over products and people in the store or street and provide virtual, ‘in situ’ hands-on demonstrations and deliver the ultimate ‘guide’ to our complex physical world. Is AR the new 3D viral experiential marketing or another temporary fad?

Finally, finally for those interested here is my Augmented and Mixed Reality YouTube playlist if you have an hour or so to spare to view the current collection of 60 +

We have come a long way since cardboard cutout VRML back in the 90s. It is interesting to watch a revolution take place at the moment in Mixed & Augmented Reality and one particular subset, augmented reality. Gary produced a compilation in 2008 of various AR and MR area in this short video (at the bottom of this post you will find a transcript)

Another exciting area of AR is emergent game play. This example from a Japanese company called Geisha Tokyo Entertainment is your very own augmented reality Geisha Girl. It is interesting watching a story develop so imagine the potential now for story tellers or performers who can give their ‘participant’ audience the tools to bring the storyworld out into their personal space. I think in advance of the oft mentioned ’surround-o-film’ (yes holograms of Bond jumping around you in your front room, god help us!) this is a simple and elegant solution – given we all have webcams built into laptops, games consoles, mobiles etc etc: With this particular package you get two cubes and two sticks but imagine a cube for a range of characters or sets for your latest film or kids TV show, perhaps available as a premium.

Finally the combination of Augmented Reality and Social Media is probably the most obvious and compelling near term offering. Being able to layer the rich social web over the top of the real world adds real value. This video speaks for itself.

Below is the slightly futuristic transcript from my video compilation above, for those who can’t hear the narration. (BTW a better audio version available as a 50MB download here). Attribution for most clips appear in this post.

Is this reality? Is this fantasy? In 2008 the great transition truly began. Whereas a decade earlier we used to ‘log in’ to cyberspace, now we began to semi-permanently inhabit virtual space and the digital world started to leak out into everyday life. It began to infiltrate our shopping malls and became integrated with our everyday lives. Humanity started the relentless journey towards the natural future where virtuality became a greater reality,  and where digital fantasy and organic reality were inextricably intertwined.

Through the early 2000s pervasive wearable computing started to break down the walls that used to separate our virtual existence from our physical one. This same technology also allowed us to embed ourselves seamlessly into virtual worlds which is where we could truly experiment with future forms of entertainment, art, education and business.

In these new places we became the real time, living celebrity. Many of us became avatar stars, pixel gods – exalted as those linear film and TV icons. This became the only place for many. By 2007 hardcore gamers were already spending fifty five hours per week ‘inside’ these shared worlds and learned to forgot about the real world. This became the place where their most meaningful hours were spent. Everyone began to blend the two domains, combining them in new ways, driven by an invisible urge. Thus started the global meshing, of today’s mixed reality.

But in 2009 questions were asked. As in the many films that hinted at our transhumanist future, would the physical embodied self ever become redundant? Would we truly evolve as self contained, digital entities? May we as well be slumped in a chair with a cable plugged into our heads? Regardless, as the real world became inhospitable we all started to crave for the immersion and began moving our physical selves into these spaces. Even more than that we wanted our peers our un-virtual audiences to be able to share our experiences there. It became a contagious as the most poignant moments and memories were the ones in virtual space.

But we needed to look beyond these screens and into our own souls. Find the truth written along the ‘thin white line’ that separates analog from digital, person from avatar. This was the beginning. It always was. As far as the meshing or blending of reality and virtuality, in 2009 they were the equivalent of grainy black and white movies seventy years earlier. Our experiences were simultaneously part real, part virtual but it didn’t matter which was which anymore. Both were valid and they depended on each other. Those early parallel existences of twenty years ago started to move humanity forward, released our imaginations and we coexisted with our precious and ultimately fragile, physical selves. The great crossing had begun.

Tran-social-media-play [tran-soc-shuh-mee-dee-uh-pley] noun, verb

1 noun – a new form, a means of collaborative communication through play in constructed shared ‘media-rich’ environments

2 verb – taking part in game-like activity across and within online and offline social networks and media portals.

Can we truly create meaningful immersive media ‘experiences’ for others? Ones that last, are memorable, have impact & emotion and keeps the ‘experience players’ coming back for more? I am currently building services, working on papers and delivering courses on Experience Design and this post is a quick summation of some of the background thinking and good case studies.

Life is filled with so many exciting twists and turns. Hop off the straight and narrow whenever you can and take the winding paths. Experience the exhilaration of the view from the edge. Because the moments spent there, that take your breath away, are what make you feel truly alive. © 2000 Stacey Charter

Filmmakers and marketeers are clearly moving into #TranSocialMedia Play in a big way with a triple whammy at the moment of Star Trek, Terminator & Lost (fan) ARG’s and a raft of social media campaigns across other film and TV properties (some much better than others!). I have written about worlds immersion and cross-media design many times in the past but this post looks at the addition of social play into the mix – a permanent fixture.

Transocialmedia play design has historically been the domain of theme park builders, after dinner murder mystery writers, letterboxers or installation artistes – always based in the physical realm with the best examples reliant on group social interaction. But immersive play like this has also been with us since the first MMOGs social games inside fantasy environments and are another side of a triangle which also includes the new kid on the block (adolescent teenager) 2D social media. The main premise of the below diagram is simple – all encompassing transocialmedia design should be centered in the triangle and incorporate these three dominant forces. (there is a lot more to the diagram especially around hybrid services, but it will have to be another post)

TANGENT

A minor diversion but totally related to hybrid services, I was sent a tweet from Ms. NPRIL last night.

BettinaTizzy“Could Disney-Pixar’s 3D film up lift virtual worlds?” this blogger asks. http://tr.im/lEkm – What do you guys think of this? @GaryPHayes?

@BettinaTizzy Good 3D opens the door, inside? the anim film delivered as an auto story route in a home 3D engine where you can also explore!

The actual article was about exposing large numbers of non-gamers to 3D and whether this would turn them into ‘virtual world’ participants. But more than this I am always keen on drawing attention to media forms in collision and future looking mash-ups – as cinema becomes 3D and games engines become filmic (quality wise) why not deliver the film inside the game engine – not as cut cinematic 2D but the whole thing in 3D. You press play and the story arcs unfold around your avatar (perhaps your invisible perhaps your an extra – who knows!), voices play out from the characters and in some scenarios you can interact where the story makes sense. You as the film player can move around inside the environment the drama is taking place, certain action scenes you can jump inside characters and so on. That way from a screen entertainment point of view at least, you can also play/backchat with your social peers inside and around the story – now that would be an experience?. But this is really another whole post so I will continue…

BACK TO THE STORY

The ‘online distributed story’ courses to Directors and Foundation students at AFTRS often start with thinking about what is the nature of true meaningful collaborative play and what serves the story. What does one need to ‘create’ to turn passive story viewers into active story players? When we talk about play there are two key ‘spaces’ – within the screen and with-out the screen. Students already immersed in online 2D social space immediately don’t see the value of the social mediums – asking a fish to explain water. They soon see the potential though unlike many ‘non-social online’ creators who often try to merge crude old-school practise into fragile social media and like a bull in a china shop find it hard to engage. I use a variety of tools and exercises but the simple workshop template below helps story tellers plan and quickly understand two sides of the triangle – 2D social media and 3D online worlds.

But as we know screen media only tells part of the story which is why promotion agencies and enlightened storytellers alike are (to borrow from Dale’s Cone of Experience again) moving into memorable forms of contrived and direct purposeful experiences in the real world and realise that real stickiness will come from the activities at the bottom part of Dale’s Cone.

This is all leading to a few recent examples in the transocialmedia space – mostly campaign casestudies hence the marketing bias and hat tip to casemovies for some. The first is from 42 entertainment, demonstrating how to create purpose, community and elements of role play on massive scale as part of the lead up to the Dark Knight film last year.

Another major launch last year was for Halo 3 and as they were really promoting 3D virtual space it made sense that the unique elements of this transocialmedia offering (albeit low on the social side) was the creation of a large physical model to bring virtual into physical space and then promote the ‘memorial’ throughout urban environments. Halo 3 incidentally became the biggest entertainment launch of all time.

I often use these four simple levels of cross-media design that I wrote on wikipedia some years ago as a framework to differentiate using platforms as just distribution (CM1) at one end to a seamless contiguous experience at the other (CM4). The fan created Star Trek Alternate Reality Game linear summary of a typical user journey, certainly adheres to the description CM4 ‘experience’ and goes where other ARGs have not gone before!

Cross-media 1.0 – Push. Minor variations of the same content placed on different platforms. E.g.: A slight re-edit of the audio for podcast or a transcript diced and sliced for a making of type website and more of now, watch the TV show on the TV, web or the DVB-H or 3G mobile phone or an iPod video download.

Cross-media 2.0 – Extras. Content that is already being produced but not destined to be delivered and repackaged onto other platforms so it appeared to be ‘original’ or at least specially created. More about the wonders of a good content management system than the true potential of cross-media.

Cross-media 3.0 – Bridges. Where most innovative 360 thinking is currently rooted – where the content placed on the other platform is critical to staying in touch with the narrative or service.The narratives tease you towards investigating or moving (via a bridge) to another media form/platform.

Cross-media 4.0 – Experience. To some extent this is producer ‘hands-off’- in that they have created an environment, much like a game, that the participant/s ‘lives’ inside of, following their own path, personalizing the experience. A cross-media 4.0 property is at its height a creation, a collaboration with the audience across many devices, which evolves and grows a life of its own.

As an interlude, an example that only uses two sides of the triangle that I had to include which demonstrates the power of a contrived, controlled physical event that then massively propagates across 2D social media – yes it’s Antwerp Train Station does Sound of Music.

An example of traditional ARG design that fails to use two sides of the transocialmedia triangle and will get lost in the noise is the rather stalled Skynet series of videos that were being used to launch the new Terminator movie. It does have an interesting Twitter element at http://twitter.com/skynetresearch that is now spilling out into Facebook and beyond – worth keeping an eye on. “Skynet Research is dedicated to eliminating human error.”

I had to add this example for two reasons. It is very clever marketing first and foremost morphing the meaning of a basic food product into one of the scariest browser ‘environments’ on the web – also it combined the two sides of the triangle 2D social and 3D world by creating the browser world – Hotel 626 as real horror experience. Many users were actually too terrified to explore this space – not bad for Dorritos!

Transocialmedia play design is still in its infancy as all sides of the triangle above evolve. Social networking is constantly moving towards being more real time as twitter growth demonstrates. 3D worlds are becoming much more integrated with real and 2D social space as well as becoming a far more ‘representative renderl’ of the real world which itself is being invaded with highly sophisticated mobile and pervasive computing devices. The real challenge at the moment is avoiding gimmick and surface superficiality but developing deep well threaded stories that afford a deeper more investigative engagement. I have noted the design of recent ‘media plays’ to be rather linear, find clue A that leads to clue B and so on vs much more non-linear quest. Many also fall into being over authored, complete and don’t allow contribution or collaboration (although that will happen regardless somewhere else if you haven’t allowed for it). One of the biggest challenges is to mature the form.

There are many who see transocialmedia play as purely marketing, there to sit on the coat tails of existing well known brands (such as AI, Halo, MacDonalds/Olympics) vs being of themselves for themselves. Admittedly there are a few of these scattered around but the player base is usually much lower. To finish a small, mini ARG transocialmedia play I designed last year called the Old Forest – which had a good mix of 3D mashed with physical world and a team social component. The story was fictional, looking at witches, spells and fires – you can find more detail about this and other mARGS on the Laboratory for Advanced Media Production wiki.

There was a rather sad epitaph to this mARG as exactly a year later the whole town of Marysville was tragically burnt with great loss of life in the worst Bushfires in Australia’s history. Truth is far stranger than fiction.

Appendix

For reference here is a abridge copy/paste from a post on an immersion post from 2006 – looking at the factors that enable immersive experiences.

SCALE – of the experience. The size of the screen and the amount of story world to explore has enormous impacts on immersion – as well as the detail of individual objects within the ‘world’. One of the reasons cinema will exist for a long time is that the large dark room filled with people is a captivating environment. Now, imagine a cinema where the image is a locked off-shot, of a shared world and all the audience are controlling and representing different characters engaged in a common goal or story. Ummm.

SENSES – goes without sayiing that the amount of senses that are engaged by an experience gives it most potential to immerse. Now as I have said before we dont need to consider full immersive reality rather make sure as well as intellectual and emotional engagement you consider sounds and the grammar of visual. Probably forget about touch, taste or smell for the moment – leave that to the porn industry to work out.

SERENDIPITY – how the world or show you are watching has elements of surprise. As mentioned earlier the more scripted and formulaic the less immersive. People only watch a film for the fifteenth time, I believe, because they strangely hope that there may be something different OR they are peeling back the layers, looking at minute detail and looking way beyond the basic narrative.

STORY – does the narrative engage. This is obvious, if there is nothing for you to be drawn along by (even your own story in some cases) then you will switch off.

PERSONALIZATION – Hence the title of this blog. How much can you minutely affect the world and yourself in it? How much will the world reflect you for being there? Most importantly, how much of your real world personality can you bring with you into the experience.

RESONANCE/CHOICE – How much control or agency do you have over the experience? Are your actions permanent and seen by all? Can you really do and say what you want – freedom of choice. True resonance is like a virtuous circle, you do something and there is a response that forever changes the environment. Like real life. The pushed media of TV, radio, cinema has zero resonance, it all happens in your head. Which is why stories ‘have’ to be based on life’s shared drama. In truly interactive models your actions have impact and will reaction will take place.

TEMPORALITY – How real time does the experience feel? Scheduled TV never feels real time – the only successful shows in the future will be live events, music, sports, live news etc: Everything else has a dubious future in the scheduled world. MMORPGs feel real time when you are in them because of all of the above. Ones that have scheduled events or require you to invade or fight at a certain time are more about story than true immersion.

ESCAPISM – or ‘play’. This goes back to my earlier point about the reason for play and associated spirituality. Is it as much about escaping reality or constructing ideality?

Does the representational nature of these ‘experience’ worlds mean so much more subconciously than endless souless advertisements on TV, or another episode of a soap, or fomulaic hollywood film? Does selecting an identity that is impossible to achieve in real life become a most powerful addictive escape? I suspect all of the above. In terms of building ‘play’ – it should be as fun making it as doing it. I have mentioned before that sometimes authors of experience get so lost in the creation process they forget someone has to watch, play or take part in it! Then it is much weaker an experience.

Below are my slides, a little descriptive text below that and at the bottom of this post some deeper insight into SmallWorlds (given most of my readers probably know Habbo already? – If not, Why Not!? ). I included one slide from Jeff Brookes set looking at Hitwise’s stats on browser worlds and other sites in terms of session length which will no doubt raise a few eyebrows!

Virtual Worlds & Business: What’s The ROI?

Virtual worlds are maturing at a rapid rate and brands are realising there are valuable business opportunities within them. Whether the objective is engagement, research or brand presence, virtual worlds are proving to be a legitimate marketing channel. In this session our panel will look to provide insights into the business benefits of working within a virtual world.

Presenters

• Gary Hayes, Director, Laboratory for Advanced Media Production, AFTRS & CEO MUVEDesign (Australia’s leading SL developer!)
• Jeff Brookes, Regional Director – Asia Pacific, Sulake Corporation (habbo.com.au)
• Mitch Olson, Co-Founder, SmallWorlds.com

There were several important messages in my introduction. Firstly making sure we all understand the different platforms social virtual worlds are operating on so I briefly described

1. Layered or Parallel worlds – cute 2D type avatars that move over the top of 2D web
2. Browser Worlds – walled garden that run inside web browsers, often as isometric views as flash or shockwave
3. Client Worlds – anything from 20MB to 3GB downloads of data and the world is obviously much richer than browser worlds but do need higher spec computers
4. Console Worlds – a relatively new kid on the block, social spaces that exist on games consoles. All the rendering grunt is there and the avatars are often linked to the PS3, Wii or XBox360 real life account. PS3 Home is the easiest way to match to worlds like Habbo or There.com
5. Note there are hybrids of the above and I would put ExitReality down as a hybrid of 1 and 3 as it turns a web page into a client style world

Here are the images of the above part of the presentation

I decided that a good ‘spine’ to hang the introduction on was the sort of negative questions floating around from those who don’t really understand what’s happening with web 3.0, the live virtual world space. This includes the paranoid printed press, a few out-of-touch businesses, and digital media companies/consultants more interested in iPhone/mobile games or Facebook widgets which is something they can truly explain (read: make money off).

Press hyperbole or myths?

• Virtual Worlds are on the decline?
• There’s no one in them?
• & people don’t spend long there?
• They are for kids or social ‘games’ not business?
• There are no marketing models?

But I then addressed each question in turn showing real world stats and examples. Obviously in recession investment in new tech/services are going to be hit and recent reports do suggest a consolidation of investment into kids worlds, hinting at a lowering of VC in the ones I highlighted in my presentation, but this whole area is still something education & business are advised to R&D and understand fully – as a minimum. As we know it will be new ways of doing business, more immersive and efficient ways to collaborate and alternate forms of entertainment that will be partly what will bring us out of recession.

I finished the talk with a quick overview of the main models that virtual worlds (and most online games) can be monetized. Items 1, 3 and 4 were picked up in a talk on the 2nd day of ad:tech looking at how Nike engaged with console ingame campaign experts Massive across a few platforms.

1. Static Advertising
2. Promotions & Sponsored events
3. Virtual Goods & Product Placement
4. Dynamic InWorld Advertising
5. Branded Spaces
6. AdverWorlds & AdverGames

After my talk some great examples from Jeff Brookes from Habbo followed by Mitch from Smallworlds. I am always fascinated by the methods Habbo engages with its loyal and large community and was equally fascinated by Small worlds thinking too and how they are ‘integrating’ themselves with the existing 2D social networked web. This video by the infamous Robert Scoble features Mitch Olsen and Ted of SmallWorlds

They talk about the main traditional world features but then go onto the interesting areas of embeddable worlds (the Google Lively Killer app – not exploited), API integration with almost anything (twitter feeds, YouTube vids, FB updates on walls anyone) and the most interesting ‘missions’. You are encouraged to explore, meet folk, shop and basically get involved – Mitch says this is like the LinkedIn profile thinking, until your profile is 100% filled in you feel like you are missing out. I likened it much more like World of Warcraft, set players tasks, set them group tasks, give them rewards. This to me could be SmallWorlds real killer applet. At the moment they have around 400 000 users and that looks set to take off in the next months.

Tony Fendall blogged about a particularly cute feature that allows (his words) -

One important thing which was missed is that they didn’t have time to talk about all the cool micropayment features (which Ted alludes near the end) such as Gambit, OfferPal and Zong. Gambit and OfferPal are both services which allow users to earn SmallWorlds currency by completing tasks. These tasks include things such as answering surveys and give amounts of currency proportional to the amount of effort put in. This is a great way for players (who may not have a credit card) to still be able to earn a premium SmallWorlds experience. Zong is a simple cell phone payment service, where by users can pay for a premium SmallWorlds experience using their mobile phone. For an excellent look at how we have integrated Zong into SmallWorlds, check out this YouTube video created by the developers at Zong:

Note a cross post from Gary’s other main blog personalizemedia

There have been several forays by TV properties (gradually losing their audience and associated ad revenues) into social virtual worlds over the past two years. I don’t just mean branded one-off events but actually setting up shop, building a familiar and representive space for the ‘users’ to play in. These forays range from at one end, simple branded spaces pushing episodes on screens through to actually running variants of the TV format to be played out by participant avatars in a detailed build -with many points in-between. But before the meat of the post (a couple of new entrants) here is a quick list to give you an idea of some of the shows and channels that have tried, had some success or failed. As I have been involved in a few of them and visited all, I have listed ones I think have had most impact (engagement) through to those who didn’t quite get it (reversioning).

1. NBC’s Gossip Girl
2. MTV’s – Laguna Beach on There.com (also Hills, PimpMyRide etc)
3. Big Brother – PersonalizeMedia detailed report & at launch
4. Showtimes The L Word
5. CBS – CSI:New York and from TechCrunch
6. Weather Channel – Info, simulations and Extreme Sports area
7. Australia’s ABC TV Island – Channel & some programmes (eg: Librarians)
8. NBC Universal Media Island – Channel & concerts & events
9. London Live – the first music show to appear on the cyberchannel: Virtual Life.TV
10. SkyNews Island – News Set role play
11. The Money Programme BBC screening
12. Channel 4 – Radio Station
13. Sundance Channel – Virtual screening room
14. Inhabited TV 1997! – BBC, BT, Illuminations and others
15. many more…0ver to you and comments!

There is a rule of thumb regarding TV execs and virtual worlds or serious games initiatives – do not let the TV folk take control as they have too much ingrained baggage around non-participatory media and the resultant compromise is often of no use to anyone – get people who understand game play (and be aware that often excludes traditional game developers) and social media involved or face the consequences. The ones above that really worked allowed the participant audience to really ‘live’ in the shoes of the characters either by having activities similar to the protagonists, meeting the ‘fictional characters’, a social space that resonated with the shows aesthetic or a great set with game-like elements. I have talked a lot about Mixed Reality Entertainment in the past and how one of the most innovative uses of virtual space is to extend the TV or Film property into a 24/7, participatory environment. The main reason for doing this is to drive traffic to the TV but also to keep existing followers loyal to the branded property. As an example there is more detail about the reasoning on my post on Big Brother (good and bad) in Second Life (Witnessing the Birth of an Entertainment Form) as well as posts nearby on CSI in Second Life and many of MTVs properties in There.com (TV Property Branded Virtual Worlds – The Beginning). There are moves around the world including BBC and many European broadcasters who are creating worlds alongside and in some cases in front of the TV episodics and this is the important point. Promoting films with games or virtual world spaces has a very limited life span, forging a strong link between virtual world events and TV episodics is to me a virtuous circle – especially considering the 200 plus worlds populated by the youth audience who are typically turning off TV – teens and tweens. Earlier there were many experiments of TV/World hybrids and I was involved, as mentioned before, in the Mirror. Here is John Wyver (then Illuminations) talking about that (remember this is circa 1997!).

The other key element that contributed to the success of The Mirror, much as in real life, was the provision of regular “hosts” for the space. These needed to be frequent visitors who spent a significant amount of their time in the world, and whom users could have some reasonable expectation of encountering when they logged on. These hosts would greet new entrants, introduce people to each other, point out activities and generally help people around. More than this, however, over time they became the core of the community of the world, encouraging people to return and beginning to develop the particular language and culture of The Mirror. Needless to say, they were the saddest to see it turned off after seven weeks – although a number of relationships begun virtually have continued in the real world – including at least one marriage and one recently born child.

Recent company start-ups or collaborations also suggest that there are moves afoot. Icarus studios are squarely aiming at the TV/VirtualWorld hybrid and about 18 months ago Endemol & EA teamed up to create Virtual World TV formats (VirtualMe) based on Deal or No Deal and Big Brother. Also there have been a plethora of immersive film launches (play-in-the-set-type builds) across the metaverse and I Legend, Digital Hollywood, Iron Man, Quantum of Solace and Transformers spring to mind as I write – but as I said this post is more to do with a continuous, what happens on TV resonantes into the virtual world and what happens there is reflected into the TV episodics. (I regularly consult on this specific area so won’t go into any more detail!)…

So, it is interesting to see this trend continuing as new world Twinity starts to do more experiential ‘film’ property marketing and even more ‘demographically focussed’ the current series of Heroes being extended into Habbo

The agreement was brokered by the William Morris Agency and marks the first time ‘Heroes’ has partnered with a virtual world.

..but not in the usual way. As reported by LA Times “‘Heroes’ hops on to Habbo’s virtual world” they will be introducing a virtual-only character Syn Anders who will act as a bridge or guide to the TV series. NBC themselves give more detail here.

While following directions from a mysterious virtual messenger, the new character will take the audience on an adventure as she discovers the history of ‘Heroes’ through a journey that travels back and forth between Habbo.com and the ‘Heroes’ Evolutions site. “We’re excited to work with Habbo to introduce a new character that will extend the enormously popular and Emmy® Award winning ‘Heroes’ interactive story beyond the official Web site on NBC.com,” said Stephen Andrade, senior vice president, Digital Development and General Manager, NBC.com. On Habbo.com, fans of the show will be able to interact with the new virtual hero through a variety of in-game activities. Habbos participating in a weeklong quest will discover their own special powers and will be recruited as new heroes. Those who successfully complete the mission will be awarded various virtual prizes. On the ‘Heroes’ Evolutions site, the new virtual hero will be woven into several of the in-universe, interactive extensions of the on-air show, including a character profile, the Primatech Paper Assignment Tracker and new chapters of the ‘Heroes’ graphic novels.

This is a great use of virtual worlds and it also shows that you don’t need richly rendered environments to be able to engage with participants in these spaces. Also in terms of the ‘linking’ paradigm, it is close to ‘my’ level 3 wikipedia cross-media definition

Excerpt “Cross-media 3.0 – Bridges. – The truest form of cross-media where the story or service structure is specifically authored to drive the audience using strong Call-To-Actions, across media devices to continue the journey. The content placed on the other platform is critical to staying in touch with the experience and the narrative bridges tease you towards investigating or moving to another media form/platform. Obvious examples include a TV show that ends suddenly and gives you a URL to explore more. It may be an SMS that teases and points you towards a live concert in a city square which then leads you to a TV show, then to a podcast then to subscription emails. The trigger, or bridge, is the critical component of this in motivating the cross-media action.”

Onto Twinity and the images here and above are me playing around in the pre-build set of the recently released and not universally praised film The Spirit. Although it grossed $10 million in the first 4 days it was pulled up for being unemotional and 2D. Well part of the problem generally with many big features now is that audiences have changed and want something more experiential – especially with ‘comic-noir’ films – why not let them ‘live’ in the story environment (my wikipedia item)? Twinity though have teamed up with Will Eisner studios to do this event (not in any way my ideal episodic but potentially a way for the Twinity user base to ‘create episodic, comic-noir’ machinima on-going?

CineStar Spirits you Away to Another World – CineStar’s CUBIX cinema in virtual Berlin is the premiere address for all movie-related events in Twinity. The cinema is currently showing the trailer and other exciting movie material from the upcoming premiere of The Spirit, a movie based on Will Eisner’s cult 1940s comic book series, which will be coming to a cinema screen near you from 5 February. Fans of the movie can get their hands on exclusive Spirit merchandising: including posters, standees, and an incredible Spirit mask that lets you see special visual effects inworld. Find more information here. Save the date and come to the opening party!
Date: Monday, 2 February
Time: 17:00 Berlin, 11am NYC, 00:00 Singapore
Where: CineStar CUBIX

Twinity (by Metaversum, the German created virtual world) are a long ways from a mature stable platform, hence being in beta for the past 12 months or so, but are already exhibiting the best ‘world-led’ event-based, user activation. This in my mind is high on the list of reasons for likely success over many of the areas that over-hyped Second Life suffered from in the early days. OK the world is quite big and empty and many ‘social’ tools are not yet available inworld but the kind of activity quoted below (calling for videos, images, stories etc: attached to some well know brands) is great first step community building and more importantly getting a growing community to market for you. Even I had a go at one a few months ago – video embedded below BTW Metaversum you really need to improve the video tools (detached camera please!).

Submit Your Artwork and Win! – Take part in The Spirit Screenshot and Machinima Contest and win an exclusive film poster signed by cult film director Frank Miller or The Spirit action figures.
Things Are Looking A Little Different Around Here…
Wear the mask and see Twinity through the eyes of the Spirit! – Use Twinity’s screenshot and recording tools to create incredible Spirit- inspired images! To be eligible to win the contest, screenshots must be created while wearing the Spirit Mask and its ‘visual effects’ must be demonstrated in your machinima. Screenshots may be submitted in jpg, png or gif formats.
Sensational Prizes - You have the chance to win sensational The Spirit prizes! Three prizes will be given out to the lucky winners of the Screenshot and Machinima Contest:
* 1st prize: The Spirit action figure and film poster signed by Frank Miller
* 2nd prize: The Spirit film poster signed by Frank Miller
* 3rd prize: The Spirit action figure
To take part in the contest, all you have to do is:

• Submit your screenshots together with your Twinity name to quest@twinity.com or
• Upload your movie to a video sharing website, for example “YouTube”, then submit the link to your uploaded video together with your Twinity name to quest@twinity.com
• Competition deadline: 28 February 2009

We’ll celebrate the winning entries with a Winner’s Gallery party in the CineStar Event Hall! Artwork will be displayed in the CUBIX cinema during The Spirit promotion. Keep an eye on Twinity’s Event Calendar for further details!

Of course I would encourage all TV producers to think about their current audience and whether they want to reach them this way. More importantly you need to think of the appropriateness of creating inworld characters or environments for them to exist in – serious games (from documentaries) and childrens episodics are hot ones at the moment . The real effort is more about having great characters that are persistant in the space but beware of bots or NPC’s (non player characters) pretending to be real, this can have a strong counter productive effect. More later.