MIXED REALITY

INTRODUCTION

Mixed Reality encompasses all these fields of Reality - Physical Reality, Augmented Reality, Augmented Virtuality, Virtual Reality - that surround us today with the mergence of computers and digital means. It refers to spaces, which consist of physical and virtual elements that interact with one onother, where a certain type of Reality is experienced when we enter them. It deeply affects various fields, from sociology to informatics, and from art to architecture. Although it refers to quite new technologies, the basis of Mixed Reality theory has already begun being investigated thousand of years ago, through philosophy and mathematics.

Mixed Reality presents a challenge to contemporary architecture, although little study has been done on the ways the mixture of the various types of Reality, which span the Physical Reality - Virtual Reality, continuum affects architectural design. Taking into account the changes that are taking place to our environment, architectural design should suitably and effectively amend its principles to respond to these changes. For further information on the relation between Architecture and Mixed Reality, see The Mixed Reality Project in Architecture.

CLASSIFICATION OF MIXED REALITY SPACES

Categorisation of spaces where physical and virtual elements interact with one another can have many alternatives. They can be classified based on various criteria depending on the point of view we study them, e.g.

• the way we experience a certain type of Reality [no additional equipment needed, additional equipment could be used, additional equipment needed), see My_MR_Lab, Virtual Reality Gloves
• the way we enter the space, i.e. physically, virtually, constantly shifting between physical and virtual way, hybrid ways of our being partly physical and partly virtual present
• the structure of the system, i.e. a single physical/virtual space, many physical/virtual spaces from where visitors have access at one common physical/virtual space. A common virtual space enabling users in geographically distributed (physical) sites to collaborate in real time as if they were in the same physical room, is called Tele-immersion (see LINKS in this page)
• context discontinuity a Mixed Reality space has: its elements, having been separated to physical and virtual, do not make sense, are irrelevent e.t.c., see The Mixed Reality Project in Architecture.
• context continuity a Mixed Reality space has: its elements, having been separated to physical and virtual, do make sense, are relevent e.t.c. but when considered/experienced together a different point of view is granted to us, see The Mixed Reality Project in Architecture.

A MIXED REALITY TABLE

	PHYSICAL REALITY - VIRTUAL REALITY CONTINUOUS LINE SEGMENT
type/flavour of Reality	Physical Reality	Augmented Reality - intermediate case	Augmented Virtuality - intermediate case	Virtual Reality
space properties	a completely physical space which has no virtual elements	an Augmented Reality space is a physical space where virtual elements have been integrated	an Augmented Virtuality space is a virtual space where physical elements have been integrated	a completely virtual space which has no physical elements
straight-forward examples	a forest, our office e.t.c. where no virtual elements are present	a physical space with streaming (3D) video or scanned virtual elements (mainly experienced with HMD)	a video game with streaming (3D) video or scanned physical elements, Tele-Immersion	a video game supporting VR hardware
application examples

MIXED REALITY PRESENCE

Our presence in Mixed Reality spaces can as well span the Physical Reality - Virtual Reality continuum. Therefore, except for the extreme cases of our being physically present in a physical space (in everyday life) or in a virtual space (in Augmented Virtuality), we can as well present in hybrid ways. These hybrid ways of having access to Mixed Reality spaces have been developed from the beginning due to the nature of such spaces. A Mixed Reality space which we enter just physically or virtually, appears rather bizarre.

. .

LINKS

MIXED REALITY

http://www.mixedrealitylab.org/ : Mixed Reality Lab, Singapore

http://www.mrl.nott.ac.uk/ : Mixed Reality Laboratory at University of Nottingham

http://en.wikipedia.org/wiki/Mixed_reality : "Mixed Reality" in Wikipedia

http://www.crg.cs.nott.ac.uk/~hms/ : Holger Schnädelbach - Projects: Mixed Reality Architecture, Augurscope, Storytent, Moving City, Traversable Interfaces

http://www.sics.se/dive : The Distributed Interactive Virtual Environment (DIVE) Home Page

TELE-IMMERSION

http://tele-immersion.citris-uc.org/ : Tele-Immersion@UC Berkeley

http://www.advanced.org/teleimmersion2.html : National Tele-immersion Initiative - NTII

http://graphics.cs.brown.edu/research/telei/ : Tele-Immersion, Brown University, Computer Graphics Group

http://en.wikipedia.org/wiki/Telepresence : "Telepresence" in Wikipedia

BIBLIOGRAPHY

1. Schn ä delbach et al , 2005, « Mixed Reality Architecture: Concept, Construction, Use » , Mixed Reality Laboratory, University College London .
2. Schn ä delbach et al , 2005, « Mixed Reality Architecture: initial experiences » , Mixed Reality Laboratory, University of Nottingham.
3. Vallino J., Brown Chr . , 1998, « Haptics in Augmented Reality ».
4. Vallino James , 1998 , « Interactive Augmented Reality », University of Rochester Rochester , New York.
5. Paul Milgram, Haruo Takemura, Akira Utsumi, Fumio Kishiro. « Augmented Reality: a class of displays on the reality-virtuality continuum » . SPIE Vol. 2351, Telemanipulator and TelepresenceTechnologies, 1994.
6. Paul Milgram, David Drascic, Julius J. Grodski, Anu Restogi, Shumin Zhai, Chin Zhou . « Merging Real and Virtual worlds ». Proceedings of IMAGINA '95, Monte Carlo , Feb. 1995.
7. Holger Schnadelbach, Alan Penn, Boriana Koleva, Danae Stanton, Tony Glover, Steve Benford . « Mixed Reality Architecture: initial experiences » . Mixed Reality Lab, University of Nottingham , Technical Report Equator, 2004.
8. Holger Schnadelbach, Alan Penn, Steve Benford , Boriana Koleva . « Mixed Reality Architecture: Concept, Construction, Use » . Rodden, T. ed. Technical Report Equator University of Nottingham, 2003.
9. Steve Benford, Sally Jane Norman, John Bowers, Matt Adams, Ju Row–Farr, Boriana Koleva, Ian Taylor, Marie–Louise Rinman, Katja Martin, Holger Schnädelbach and Chris Greenhalgh . « Pushing Mixed Reality Boundaries ». Erena Deliverable 7b.1-1, February 1999.
10. Paul Milgram, Haruo Takemura, Akira Utsumi, Fumio Kishiro . « Augmented Reality: A class of displays on the reality-virtuality continuum » . SPIE Vol. 2351, Telemanipulator and Telepresence Technologies (1994).
11. A. Galani, M. Chalmers, B. Brown, I. MacColl, C. Randell, A. Steed . « Developing a mixed reality co-visiting experience for local ad remote museum companions » . Museological Review, 10. 2003.
12. Areti Galani . « Mixed Reality Museum Visits: Using new technologies to support co-visiting for local and remote visitors » . Department of Museum Studies, 2003.
13. Areti Galani. «Lessons from the lighthouse: Collaboration in a shared mixed reality system» . 2003.
14. Areti Galani, Matthew Chalmers . "Far away is close at hand: shared mixed reality museum experiences for local and remote museum companions" . ICHIM, Paris , France , 2003 .
15. Eva Grund . “Navigation in Augmented Maps ” . D I P L O M A R B E I T”. Fachhochschule München Fachbereich Geoinformationswesen Studiengang Kartographie und Geomedientechnik Sommersemester 2004.
16. Brandon Diamond, Hai-Shuo Shu, Michael Bosworth, Ryan Myers, Dominic Latty . “Project Proposal: CIT Doom” . Innovating Game Development CS196-2.
17. Ronald Sidharta, Adrian Sannier, James Oliver . “Augmented Tangible Interfaces For CAD Design Review ” . Virtual Reality Application Center Iowa State University . International Conference on Product Lifecycle Management.
18. Daniel Dobler, Michael Haller, Philipp Stampfl . “ASR - Augmented Sound Reality ” . Fachhochschule Hagenberg (Medientechnik und -Design), A-4232 Hagenberg, Austria . SIGGRAPH 2002.
19. Mark Billinghurst, Hirokazu Kato, Ivan Poupyrev . “The MagicBook Moving Seamlessly between Reality and Virtuality” . IEEE Computer Graphics and Applications. May-June 2001.
20. Stephan Veigl, Andreas Kaltenbach, Florian Ledermann, Gerhard Reitmayr, Dieter Schmalstieg . “Two-Handed Direct Interaction with ARToolKit” . Vienna University of Technology , Austria . ART 2002.
21. Miguel Dias, Joaquim Jorge, José Carvalho, Pedro Santos, José Luzio . “Usability Evaluation of Tangible User Interfaces for Augmented Reality ”. ART 2003.
22. Nadia Magnenat-Thalmann, George Papagiannakis . “Virtual Worlds and Augmented Reality in Cultural Heritage Applications” .
23. H. Regenbrecht, M. Wagner, T. Lum, P. Kohler, W. Wilke, E. Mueller, DaimlerChrysler, Holger. "An Augmented Virtuality Approach to 3D Videoconferencing" .Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '03) .
24. Kristian T Simsarian, Karl-Petter Akesson. "Windows on the World: An example of Augmented Virtuality" . Swedish Institute of Computer Science S-16428 KISTA Stockholm , Sweden . 1997.
25. Hrvoje Benko, Edward W. Ishak, Steven Feiner. "Development and Evaluation of Mixed Reality Interaction Techniques" . Department of Computer Science, Columbia University . 2005.
26. Shahram Izadi, Steve Benford, Keith Cheverst, Pedro Coutinho, Martin Flintham, Mike Fraser, Chris Greenhalgh, Keith Mitchell, Tom Rodden. "A Citywide Mixed Reality Performance: Initial Findings" . Mixed Reality Laboratory, University of Nottingham and Department of Computing, Lancaster University . 2001.
27. “Tele-immersion” . CITRIS, Centre for Information Technology Research in the Interest of Society. April 2005.
28. Bruce Thomas, Nicholas Krul, Benjamin Close and Wayne Piekarski. “Usability and Playability Issues for ARQuake” . University of South Australia . 2002.
29. Wayne Piekarski and Bruce H. Thomas . “ARQuake - Modifications and Hardware for Outdoor Augmented Reality Gaming” . Wearable Computer Laboratory School of Computer and Information Science University of South Australia . 2002.
30. Bruce Thomas, Ben Close, John Donoghue, John Squires, Phillip De Bondi, Michael Morris and Wayne Piekarski . “ARQuake: An Outdoor/Indoor Augmented Reality First Person Application“. School of Computerand Information Science University of South Australia . 2000.
31. Matt Aronoff John Messina . “Focus: Augmented Reality for Standards”. National Institute of Standards and Technology Development. 2002.
32. José Miguel Salles Dias, Antoni Jaume i Capo, Joan Carreras, Ricardo Galli and Manuel Gamito . “A4D: Augmented Reality 4D System for Architecture and Building Construction”. CONVR 2003 Virginia Tech, September 24th – 26th , 2003.
33. Mark Billinghurst . “Designing Augmented Reality Experiences” .
34. Leif Oppermann. “Interaktionsflächen in Augmented Reality” . Diplomarbeit, Hochschule Harz Fachbereich Wirtschaftswissenschaften Studiengang Medieninformatik. Sommersemester 2003.
35. Robert Hinn, Benedikt Redmer, Gitta Domik . “AR-Campus”. University of Paderborn Computer Science, Computer Graphics, Visualization and Image Processing.
36. Raphael Grasset, Philip Lamb, Mark Billinghurst. “Evaluation of Mixed-Space Collaboration”. HIT Lab NZ University of Canterbury , New Zealand.
37. Georg Klein . “Visual Tracking for Augmented Reality ” . Departmente of engineering, University of Cabridge . Thesis. January 2006.
38. Alan Dix, Adrian Friday, Henk Muller, Cliff Randell, Boriana Koleva, Tom Rodden, Anthony Steed . “Managing Multiple Spaces” .
39. Roy C. DAVIES, Birgitta RYDBERG MITCHELL, Elisabeth HORNYANZSKY DALHOM, Sarah NICHOLS . “Are you with us? The role of presence in Mixed Reality for Participatory Design” . Being There: Concepts, effects and measurement of user presence in synthetic environments G. Riva, F. Davide, W.A IJsselsteijn (Eds.) Ios Press, 2003, Amsterdam , The Netherlands.
40. Steve Benford, John Bowers, Paul Chandler, Luigina Ciolfi, Martin Flintham, Mike Fraser, Chris Greenhalgh, Tony Hall, Sten Olof Hellström, Shahram Izadi, Tom Rodden, Holger Schnädelbach, Ian Taylor. “Unearthing virtual history: using diverse interfaces to reveal hidden virtual worlds”.
41. Boriana Koleva, Holger Schnädelbach, Steve Benford and Chris Greenhalgh . “Experiencing a Presentation through a Mixed Reality Boundary” . The Mixed Reality Laboratory, University of Nottingham .
42. Matthew Chalmers , University of Glasgow . “The Equator ‘City' Project” . Position Paper for the 1st UK-UbiNet Workshop.
43. M. Fjeld, F. Voorhorst, M. Bichsel, H. Krueger & M. Rauterberg (2000): Navigation Methods for an Augmented Reality System. In the video program / extended abstracts of CHI 2000, ACM, pp. 8-9.
44. Werner Hartmann, Jürgen Zauner, Michael Haller, Thomas Luckeneder, Wolfram Woess. "“Shadow Catcher”: A Vision Based Illumination Condition Sensor using ARToolkit" .ART 03
45. Dr. Axel Hildebrand . " Augmented Reality, What for?". CG topics 1/98
46. Michael Haller, Stephan Drab, Werner Hartmann . "A realtime shadow approach for an Augmented Reality application using shadow volumes".
47. M. Haller, S. Drab, W. Hartmann, and J. Zauner . "A real-time shadow approach for an Augmented Reality application using shadow volumes". Upper Austria Univeristy of Applied Sciences, VRST 2003, 1st-3rd October, Osaka , Japan.
48. Fotis Liarokapis. "An exploration from virtual to augmented reality gaming ". City University , UK.
49. Christian Geiger, Leif Oppermann, Christian Reimann . "3D-Registered Interaction-Surfaces in Augmented Reality Space" . ART 03.
50. Jurgen Zauner, Michael Haller, Alexander Brandl, Werner Hartmann . "Authoring of a Mixed Reality Furniture Assembly Instructor".
51. Chris Greenhalgh, BA . "Large Scale Collaborative Virtual Environments ". Thesis submitted to the University of Nottingham for the Degree of Doctor of Philosophy, October 1997
52. Ruzena Bajcsy . "Tele-Immersion". UC BERKELEY , UC DAVIS , UC MERCED , UC SANTA CRUZ . 2005.
53. Michael Haller, Werner Hartmann, Thomas Luckeneder, Jürgen Zauner . "Combining ARToolKit with Scene Graph Libraries". ART 02.
54. Leif Oppermann . "Interaktionsflächen in Augmented Reality ". Diplomarbeit Sommersemester 2003. Hochschule Harz Fachbereich rtschaftswissenschaften Studiengang Medieninformatik
55. Peter Supan . "Image Based Lighting in Augmented Reality Umgebungen". DIPLOMARBEIT eingereicht am Fachhochschul-Masterstudiengang Digitale Medien in Hagenberg im Juni 2006
56. Michael Krauß . "Analyse und Konzeption von Schatten virtueller Objekte in Mixed Reality-Anwendungen". Fachhochschule Kaiserslautern, Standort: Zweibrücken Fachbereich Informatik und Mikrosystemtechnik Studiengang „Digitale Medien. 2004.
57. Didier Stricke r, Fraunhofer for Computer Graphics, Germany Javier-Flavio Vigueras-Gomez, Inria-Loria, France Simon Gibson, Manchester University, England Patrick Ledda, Bristol University, England. "Photorealistic Augmented Reality". IST-2000-28707.
58. Ronald Sidharta . "Augmented reality tangible interfaces for CAD design review". A thesis submitted to the graduate faculty in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE. Iowa State University Ames , Iowa 2005.
59. Seamus Ross Director, HATII, University of Glasgow Martin Donnelly DigiCULT Forum Technology Assessor, HATII, University of Glasgow Milena Dobreva Associate Professor, Bulgarian Academy of Sciences. "NEW TECHNOLOGIES FOR THE CULTURAL AND SCIENTIFIC HERITAGE» SECTOR DigiCULT Technology Watch Report 1 February 2003
60. Rune NIELSEN , Thomas Fabian DELMAN, Tobias LØSSING. "A MIXED REALITY GAME FOR URBAN PLANNING".
61. Peter Supan , Ines Stuppacher, Michael Haller Digital Media, Upper Austria University of Applied Sciences Hagenberg , Austria " Image Based Shadowing in Real-Time Augmented Reality". International Journal of Virtual Reality, 2006, 5(3):1-10.
62. Charles E. Hughes, Christopher B. Stapleton . " The Shared Imagination: Creative Collaboration in Augmented Virtuality".
63. Jouke Verlinden, Imre Horváth, Edwin Edelenbos . "TREATISE OF TECHNOLOGIES FOR INTERACTIVE AUGMENTED PROTOTYPING". Proceedings of the TMCE 2006, April 18–22, 2006, Ljubljana , Slovenia , Edited by Horváth and Duhovnik.
64. Demis Corvaglia . " Virtual Training for Manufacturing and Maintenance based on Web3D Technologies".
65. Ronald Ecker . " Benutzerschnittstellen für Erweiterte Realität". Research Group Embedded Interaction.
66. Thomas Fabian Delman . "TheHarbour Game: A Mixed Reality Game for Urban" . Aarhus SchoolofArchitecture& Kollision, DenmarkWBI Seminar, Sept. 28. 2006.

HOME