Now ANYONE Can Build a Virtual Reality Game — No Coding Required!
Have you ever dreamed of making your own video game? Maybe a treasure hunt where players solve puzzles, or a zombie adventure where every choice changes the story? Here's the problem: building games in virtual reality — that's the world where you wear special goggles and feel like you're inside the game — has always required knowing how to write computer code. And learning to code can take years.
But what if you didn't need to be a computer genius to bring your wildest game ideas to life?
The ConnectVR Solution
A team of researchers at the University of California Santa Barbara asked exactly that. Led by Min Fan, Marko Peljhan, and Misha Sra, they built a brand-new tool called ConnectVR. It's designed so that anyone — artists, writers, storytellers — can create interactive virtual reality games without typing a single line of code.
The researchers tested ConnectVR with 15 creative people who had never built VR games before. In just one hour, every single person successfully created their own interactive story! Together, they built 96 actions and designed 147 virtual characters that players could actually talk to and interact with.
What Creators Built
The Results in Numbers
| Metric | Value |
|---|---|
| Actions created | 96 |
| Virtual characters | 147 |
| Games with 3+ chained actions | 53% |
| Median chain length | 5 actions |
| Ease-of-use rating | 4.4 out of 5 |
Twelve out of 15 people agreed that most folks could learn it without trouble.
The Real Magic
More than half of the games — 53% — connected three or more actions together, like dominoes falling in sequence. The average chain had a median length of 5 actions. Imagine if you pushed one button and it triggered a character to walk forward, open a treasure chest, and make a dragon roar — all at once!
Min
Fan
The results suggest that the intuitive, no-code nature of ConnectVR is as important as the features it enables, i.e., design of cause-effect links. This is because creators without technical expertise may want to spend more time on the creative aspects of VR development and less time and effort on the technical aspects.
How It Works
Connecting Puzzle Pieces Instead of Writing a Recipe
Users connect "triggers" (like when a player speaks or presses a button) to "actions" (like when a character walks or a door opens). The tool shows these connections as colorful visual maps that are easy to understand.
With this power, participants created wildly different worlds: treasure hunts, zombie outbreaks, fantasy lands, and even a COVID simulation. No coding required — just imagination.
Limitations & Future Work
Challenge 1
Timing tricky actions together — like coordinating speech with movement — was still hard to control.
Challenge 2
Designing very long chains of cause-and-effect was also challenging, with the longest one being just 7 actions.
Constraint
Due to COVID restrictions, workshop participants couldn't actually test their creations wearing VR headsets.
Next Steps
With only 15 people in the workshop, scientists need to test with more creators to be sure the results apply broadly.
The Bigger Picture: ConnectVR proves that building complex VR worlds doesn't have to mean hours of computer programming. For aspiring game designers who don't speak "code," this tool opens a door that was previously locked tight.
Reference: Chen, M., Peljhan, M., & Sra, M. (2024). ConnectVR: A Trigger-Action Interface for Creating Agent-based Interactive VR Stories. arXiv:2406.15889v1 [cs.HC]. University of California Santa Barbara.