Bible — VR Interaction Design

Public reference document. Complete history, principles, techniques, tools (2026 state), case studies, glossary and bibliography. Every fact is sourced.

Chapter 1 — Definitions & Conceptual Framework

1.1 What is Virtual Reality?

Virtual reality (VR) is a set of technologies that immerses users in an environment entirely generated by computer, replacing the perception of the physical world. It rests on three pillars: immersion (perceptual isolation from the real world), presence (the subjective feeling of being in the virtual environment), and interactivity (the environment responds to the user's actions).

VR differs from AR (which overlays, §AR Bible) and from classic interactive computer graphics (which does not aim for total sensory immersion).

1.2 Presence vs Immersion: a Fundamental Distinction

Immersion is an objective property of the system: degree of sensory isolation, field of view, rendering quality, latency. It is measurable.

Presence is a subjective property of the user: the feeling of being "there," inside the virtual environment. It depends on immersion, but also on content, emotional context, and the user's personality.

The distinction is formulated by Slater & Wilbur (1997):

Slater, M., & Wilbur, S. (1997). A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments. Presence, 6(6), 603–616. https://doi.org/10.1162/pres.1997.6.6.603

1.3 The Reality-Virtuality Continuum

VR and AR sit at opposite ends of the Milgram & Kishino continuum (1994). VR occupies the "total virtuality" end — the user perceives only the virtual. With the passthrough mode of modern headsets (Meta Quest 3, Vision Pro), the boundary with AR is progressively dissolving.

See AR Bible §1.2 for the complete references.

1.4 Core Vocabulary

Chapter 2 — Complete History (Chronological, Sourced)

2.1 The Pioneers (1955–1975)

1955 — Morton Heilig, "The Cinema of the Future" Visionary essay describing a total multisensory cinema — stereo images, sound, smell, vibration. Prefigures VR without naming it. (Note: the commonly cited date of 1957 is incorrect — the essay dates to 1955.)

1962 — Sensorama Heilig builds the Sensorama, a multi-sensory arcade machine with 3D film, stereo sound, vibrations, and smells. Prototype for total immersion. US Patent No. 3,050,870 filed in 1962.

Source: https://en.wikipedia.org/wiki/Sensorama

1965 — Ivan Sutherland, "The Ultimate Display" Foundational text imagining an interface where the computer controls the existence of matter — virtual space would be identical to physical space. Lays the conceptual foundations of VR.

Sutherland, I. (1965). The Ultimate Display. Proceedings of IFIP Congress 1965, vol. 2, pp. 506–508.

1968 — "Sword of Damocles" Ivan Sutherland and Bob Sproull create the first VR headset at Harvard: a heavy HMD suspended from the ceiling, displaying simple vector graphics in tracked perspective. First functional 6DoF system.

Source: https://en.wikipedia.org/wiki/Sword_of_Damocles_(head-mounted_display)

1975 — Myron Krueger, Videoplace First public demonstration at the Milwaukee Art Museum: a responsive interactive environment, ancestor of gestural interfaces. No headset — interaction via projection and camera. (Note: 1974 marks the start of the research, not the public demo.)

Source: https://en.wikipedia.org/wiki/Videoplace

2.2 Scientific and Military VR (1980–1991)

1985 — NASA VIEW Scott Fisher develops the Virtual Interface Environment Workstation (VIEW) at NASA Ames Research Center — a telerobotic simulation system combining HMD, data glove, and tracking. One of the first operational scientific VR platforms.

Source: https://en.wikipedia.org/wiki/Scott_Fisher_(technologist)

1984–1987 — VPL Research Jaron Lanier founds VPL Research in 1984. The company commercializes the DataGlove and the EyePhone (1987), the first commercial VR equipment. Lanier popularizes the term "virtual reality."

Source: https://en.wikipedia.org/wiki/VPL_Research

1991 — Virtuality Virtuality Group launches the first public VR arcade machines. VR glasses (latency > 50ms), real-time, local multiplayer. Very limited graphical quality but the general public's first contact with immersive VR.

Source: https://en.wikipedia.org/wiki/Virtuality_(gaming)

2.3 The First Boom and the "VR Winter" (1991–2010)

1993–1995 — Sega VR & Nintendo Virtual Boy Sega announces a VR headset (canceled before commercialization). Nintendo commercializes the Virtual Boy in 1995: monochrome red display, uncomfortable, poor public reception. Major commercial failure that chilled the market for a decade.

Source: https://en.wikipedia.org/wiki/Virtual_Boy

1995–2010 — "VR Winter" A convergence of insufficient hardware, prohibitive costs, and early commercial VR failures leads to a period of low consumer investment. Academic research continues (SIGGRAPH, IEEE VR), but without a major hardware breakthrough.

2.4 The Renaissance (2012–2019)

2012 — Oculus Rift Kickstarter Palmer Luckey launches the Oculus Rift Kickstarter on August 1, 2012. The campaign raises $2.4 million (initial goal: $250,000). DK1 (Development Kit 1) ships in March 2013. Facebook acquires Oculus in March 2014 for ~$2 billion. The Consumer Version 1 (CV1) launches on March 25, 2016.

Source: https://en.wikipedia.org/wiki/Oculus_Rift

2016 — HTC Vive Launched April 5, 2016 (pre-orders opened February 29, 2016). First mass-market headset with room-scale VR (active tracking of the entire room, precise 6DoF controllers via lighthouse tracking). Co-developed with Valve.

Source: https://en.wikipedia.org/wiki/HTC_Vive

2016 — PlayStation VR (PSVR) Sony launches PSVR for PS4 in October 2016. First affordable VR headset (~€400) targeting the mainstream console market. 6DoF tracking via external camera.

Source: https://en.wikipedia.org/wiki/PlayStation_VR

2019 — Meta Quest (Oculus Quest) Launched May 21, 2019. First standalone 6DoF VR headset at an accessible price ($399) — no PC required. Inside-out tracking (built-in cameras). Becomes the dominant mass-market VR headset.

Source: https://en.wikipedia.org/wiki/Meta_Quest_(headset)

2.5 Ubiquitous VR and Spatial Computing (2020–2026)

2022 — Meta Quest Pro First Meta headset with color passthrough and eye/face tracking. Orients Meta toward Mixed Reality.

2023–2024 — Apple Vision Pro Announced at WWDC 2023 (June 5, 2023), launched February 2024 (from $3,499). High-resolution micro-OLED, eye tracking + hand tracking + voice. Introduces the concept of spatial computing and the visionOS OS. Very high quality color passthrough.

Source: https://en.wikipedia.org/wiki/Apple_Vision_Pro

2016–2026 — WebXR The W3C Immersive Web Working Group has been working since 2016 on a standard API for VR/AR in the browser. First Public Working Draft: February 5, 2019. 2026 status: Candidate Recommendation Draft.

Source: https://www.w3.org/TR/webxr/

Chapter 3 — Core Principles of VR Interaction Design

3.1 Presence and Engagement

VR design aims to maximize presence: the more the user feels "in" the environment, the more they engage with the proposed interactions. Factors that increase presence:

• High-quality tracking (low latency, 6DoF)
• Auditory immersion (spatial audio)
• Physical coherence (objects fall, surfaces resist)
• Authentic interaction (hands do what they seem to do)

3.2 Comfort and Cybersickness

Cybersickness is the primary barrier to VR adoption. It results from a conflict between visual signals (movement in VR) and vestibular signals (physical stillness of the body). Aggravating factors:

• Latency > 20ms
• Continuous locomotion (analog stick)
• Fast accelerations and non-physical rotations
• Unstable framerate (drops below 60 fps)

Recognized (experimental) comfort rules:

• Minimum framerate: 60 fps (ideal: 90–120 fps depending on the headset)
• Motion-to-photon latency: < 20ms
• No camera movements not initiated by the user
• Prefer teleportation over continuous locomotion for non-habituated users

Sources: LaViola Jr., J. J. (2000). A Discussion of Cybersickness in Virtual Environments. ACM SIGCHI Bulletin, 32(1), 47–56. Kolasinski, E. M. (1995). Simulator Sickness in Virtual Environments. Army Research Laboratory Technical Report, ARL-TR-1027.

3.3 Locomotion Modes

Reference: Boletsis, C., & Cedergren, J. E. (2019). VR Locomotion in the New Era of Virtual Reality: An Empirical Comparison of Prevalent Techniques. Advances in Human-Computer Interaction, 2019. https://doi.org/10.1155/2019/7420781

3.4 Physical Interaction and Metaphors

In VR, interactions must respect physical metaphors — users expect objects to behave as in the real world (laws of physics, weight, friction). Any deviation must be intentional.

Fundamental patterns:

• Direct grab: the virtual hand grabs the object on contact
• Ray grabbing: a ray from the hand grabs distant objects
• Physics-based interaction: objects respond to real physics (Rigidbody, collision)
• Snap-to-socket: the object clicks into place (e.g. puzzle piece, lever)

VR Affordances: VR objects must signal their interactivity. Common techniques:

• Halo/outline when the hand is near (hover)
• Slight elevation or trembling ("idle animation")
• Proximity sound
• Material change on contact

3.5 VR UI: Diegetic and Floating Interfaces

Flat 2D UI imported into VR creates visual discomfort (vergence, lack of integration). The best VR experiences tend to:

• Use diegetic interfaces (in-world dashboards, dials, books)
• Avoid fixed floating popup menus (head-locked) — prefer world-locked menus
• Use hands/wrists as interface surfaces (palette on the left wrist)
• Use voice for complex commands

3.6 Audio in VR

Sound is the second presence vector after visuals. A sonic VR environment creates far superior immersion compared to a silent environment.

VR sound design:

• Spatial audio (HRTF — Head-Related Transfer Function): sound is positioned in 3D around the head
• Ambisonics: sound encoded in a complete sphere, decoded according to headset orientation
• Sound occlusion: sounds are attenuated by virtual walls (if the engine supports it)
• Reverberation: the size and material of the VR room affects the sound

Resources: Resonance Audio (Google): https://resonance-audio.github.io/resonance-audio/

Chapter 4 — VR Interaction Techniques & Patterns

4.1 Input Modes

4.2 Far Interaction

• Ray casting: ray from the hand → selection by trigger
• Head gaze + trigger: aim with the head, validate with a button
• Eye gaze + dwell: hold gaze on a target for N seconds

4.3 Near Interaction

• Direct touch: touch the object with the virtual hand
• Physics grab: grasp via physical collision (Rigidbody)
• Kinematic grab: direct grab without physics (more stable)

4.4 Advanced Locomotion

See §3.3. Additionally:

• Arm swinging: swing arms to move forward (simulates walking) — good comfort
• Redirected walking: making the user believe they are walking in a straight line while they are slightly turning — allows exploring large spaces in a small physical space. Research technique, not yet standard in consumer apps.

4.5 Bodily Presence and Avatars

The representation of the user's body in VR (avatar) reinforces presence. The Proteus effect (Yee & Bailenson, 2007) shows that avatar characteristics influence the user's behavior.

Yee, N., & Bailenson, J. (2007). The Proteus Effect: The Effect of Transformed Self-Representation on Behavior. Human Communication Research, 33(3), 271–290. https://doi.org/10.1111/j.1468-2958.2007.00299.x

Chapter 5 — Tools & Ecosystem (2026 State)

5.1 Development Engines

5.2 Platforms & Stores

5.3 Hardware (2026 State)

5.4 Spatialized Audio

Chapter 6 — Case Studies

6.1 Half-Life: Alyx (Valve, 2020)

The absolute reference for AAA VR design. Valve completely reimagined interaction patterns for VR: no continuous locomotion (physical movement + teleportation), satisfying physical object manipulation, precise haptic feedback. Released in March 2020 for PC VR.

6.2 Google Tilt Brush (2016) / Open Brush (open source)

3D painting application in VR. Demonstrates the creative power of VR as a creation tool. Google open-sourced the project under the name Open Brush in 2021.

https://openbrush.app

6.3 Medical Training & Surgery

Companies like Osso VR and FundamentalVR use VR for surgical training — surgeons practice procedures without risk to patients. Studies show significant skill gains vs. classical training.

6.4 Heritage & Virtual Archaeology

VR can recreate disappeared or inaccessible sites: ancient Rome, archaeological sites, spatial archives. Notable projects: Travelling While Black (Condition One, 2019 — Sundance), reconstructions of the Palmyra site (ICONEM).

6.5 KOUTCHI — Memory in Transit (Kamel Ghabte)

Phygital VR installation: a real, instrumented Moroccan koutchi serves as physical interface for a VR experience on migratory memory. 6 stations, WebXR/Three.js, generative AI. Part of the collection Digital Memories of Morocco / Mémoires Numériques du Maroc.

[K — technical details to confirm: exact stack, number of headsets, space configurations, tester feedback.]

Chapter 7 — Current & Future Issues

7.1 Generative AI in VR

Generative AI transforms the VR creation pipeline:

• Procedural environment generation: text descriptions generate complete 3D scenes
• AI NPCs (non-player characters): LLM + speech synthesis + animation → characters you can naturally converse with
• Real-time adaptation: the environment adapts to the user's behavior

7.2 Social VR and the Metaverse

Social VR platforms (VRChat, Rec Room, Horizon Worlds, AltspaceVR [closed 2023]) allow thousands of people to interact in VR simultaneously. They reveal new challenges:

• Harassment in VR: the feeling of presence makes virtual harassment more impactful
• Identity and avatar: freedom of representation is both emancipating and a source of identity confusion
• Accessibility: social VR spaces are often inaccessible to people with specific needs

7.3 Health, Therapy, and Well-Being

VR is used clinically for:

• Exposure therapies (phobias, PTSD): recent meta-analyses show significant results
• Pain management (burns, palliative care): Dr Hunter Hoffman demonstrated the effectiveness of SnowWorld as early as 2000
• Motor rehabilitation (stroke, paralysis)

Hoffman, H. G. et al. (2000). Virtual reality as an adjunctive pain control during burn wound care in adolescent patients. Pain, 85(1–2), 305–309.

7.4 Standards, Interoperability, and Safety

Open challenges:

• OpenXR (Khronos): cross-runtime API — progressively adopted, but advanced features remain proprietary
• Physical safety: immersive headsets cut off from the real environment — fall and collision risk
• Biometric data: eye tracking, face tracking, behavioral biometrics — ongoing regulation (EU AI Act, California CPRA)
• Avatar interoperability: no universal standard for carrying an avatar between platforms

Chapter 8 — Glossary (45 terms)

Chapter 8 — Full Bibliography

Primary Sources

• Sutherland, I. (1965). The Ultimate Display. Proceedings of IFIP Congress 1965, vol. 2, pp. 506–508.
• Slater, M., & Wilbur, S. (1997). A Framework for Immersive Virtual Environments (FIVE). Presence, 6(6), 603–616. https://doi.org/10.1162/pres.1997.6.6.603
• LaViola Jr., J. J. (2000). A Discussion of Cybersickness in Virtual Environments. ACM SIGCHI Bulletin, 32(1), 47–56.
• Yee, N., & Bailenson, J. (2007). The Proteus Effect. Human Communication Research, 33(3), 271–290. https://doi.org/10.1111/j.1468-2958.2007.00299.x
• Boletsis, C., & Cedergren, J. E. (2019). VR Locomotion in the New Era of Virtual Reality. Advances in Human-Computer Interaction, 2019. https://doi.org/10.1155/2019/7420781

Secondary Sources & Resources

• W3C WebXR Device API: https://www.w3.org/TR/webxr/
• Khronos OpenXR: https://www.khronos.org/openxr/
• Unity XR Documentation: https://docs.unity3d.com/Manual/XR.html
• Resonance Audio (Google): https://resonance-audio.github.io/resonance-audio/
• Steam Audio (Valve): https://valvesoftware.github.io/steam-audio/
• Wikipedia. Oculus Rift. https://en.wikipedia.org/wiki/Oculus_Rift
• Wikipedia. HTC Vive. https://en.wikipedia.org/wiki/HTC_Vive
• Wikipedia. Apple Vision Pro. https://en.wikipedia.org/wiki/Apple_Vision_Pro
• Wikipedia. Virtual Boy. https://en.wikipedia.org/wiki/Virtual_Boy

Further Reading

• Unity Learn — VR Development: https://learn.unity.com/pathway/vr-development
• Oculus Developer Center: https://developer.oculus.com
• IEEE VR (annual reference conference): https://ieeevr.org
• ACM CHI (HCI/design): https://dl.acm.org/conference/chi
• Immersive Web Working Group (W3C WebXR): https://www.w3.org/immersive-web/
• Steam Audio docs: https://valvesoftware.github.io/steam-audio/
• VR Compare (hardware comparison): https://vr-compare.com

Bridge to Training

This bible is a public reference document. To go further:

→ VR Interaction Design Masterclass — immersive prototype in 2 days → Intensive workshop for higher education schools and creative studios → Book a 30-min call — free