Raytraced Audio - Interactive Demo

The first version of the Raytraced Audio Demo can be downloaded here.

This demo is only available to Patrons at the moment. Testers who signed up via https://vercidium.com/audio will gain access next week.

Download and extract the zip file above, then run sectorsedge.exe. This demo is built using my old game Sector's Edge, hence the file name.

Edit: the texture issues on AMD cards has been fixed and a new version uploaded to the Dropbox folder above

Setup

The game will prompt you to select a graphics preset when you first run it. If you're facing crashes or performance issues, select ' Toaster'.

Settings are saved to AppData / Roaming / vercidiumaudio

You'll then be dropped straight into the level. The controls are:

• WASD to move around

• Shift to sprint

• Space to jump

• Q, E to build and destroy blocks

• Z to place walls/floors

  • Right click to rotate structures

• 1, 2 to change weapons

• Left click to shoot

• G to throw a grenade

Controls can be changed in Settings > Keybinds in the top right

Debug UI

The UI in the bottom left of the screen shows wind direction, reverb properties, and keybinds

Voices

A voice is a sound 'trigger' or 'spawner'. Press F2 to create one where your character is currently standing.

Then click the UI popup and press any key on your keyboard.

If you need to release your mouse cursor, press escape

Then select a sound type, e.g. ExplosionGrenade from the dropdown menu.

Now you can press N (or the key you chose) to play a sound at this location. You can change the keybind or select a different sound at any time.

When a sound is playing, click the lock icon on the right to view stats

• LOS = line-of-sight. Each vertical green bar represents how much energy each ray has when it discovered this voice

• PER = permeation. Each vertical orange bar represents how much energy each ray has left after travelling directly through walls to the voice.

The VercidiumVoice sound plays for about 8 minutes. If you want to stop it, click the pause icon on the top-left of the voice

Settings

Press escape to show the top-left settings menus. Here you can change between maps, alter the weather, change reverb parameters, and alter formulas (more on this below).

The reverb settings allow you to adjust the room size, and select different reverb presets. To mute all sounds and hear only the reverb, enable the 'Reverb Only' setting

Formulas

If you click the Variables tab in the top left, you'll see these two graphs:

These graphs are controlled by the voice_formulas.cs file, which is in the same folder as sectorsedge.exe:

These formula files allow you to directly change some of the C# code within the raytraced audio system. This is only available for developers, and will not be shipped with your actual products. As an example, this code changes the muffle graph to be a sin wave (unrealistic but demonstrates how the graph works):

For reverb_formulas.cs, you MUST write to these 5 variables:

• averageReturningRayLength

• roomSizePercent

• returningRayPercent

• outdoorLerp

• reverbLerpSpeed

Any syntax or runtime errors will be saved to these files:

• voice_formulas_error.txt

• reverb_formulas_error.txt

Variable Reference

Within both files, you have access to these variables:

• RAY_COUNT - the number of rays that are cast outwards. At the moment this is 960 and can't be changed (yet)

• MAX_RAY_BOUNCES - the number of times that a ray can bounce. At the moment this is 8 and can't be changed (yet)

Within voice_formulas.cs, you have access to these variables:

• OCCLUSION_TOTAL - the total amount of times that all rays obtained line of sight with the voice. Ranges from 0.0 to (RAY_COUNT * MAX_RAY_BOUNCES)

• PERMEATION_TOTAL - the total amount of voxels that all rays passed through. Ranges from 0.0 to infinite

Within voice_reverb.cs, you have access to these variables:

• DISTANCE_TOTAL - the accumulated distance of all returning rays. Ranges from 0.0 to infinite

• RETURNED_TOTAL - the total amount of times that all rays obtained line of sight with the listener. Ranges from 0.0 to (RAY_COUNT * MAX_RAY_BOUNCES)

• OUTSIDE_TOTAL - the total number of rays that escaped. Ranges from 0.0 to (RAY_BOUNCE * MAX_BOUNCES)

  • If a ray escapes without bouncing, it adds MAX_RAY_BOUNCES to this number

  • If a ray escapes after bouncing once, it adds MAX_RAY_BOUNCES - 1 to this number

  • If a ray escapes after bouncing twice, it adds MAX_RAY_BOUNCES - 2 to this number

  • If a ray never escapes, it adds 0 to this number

• ROOM_SIZE_MIN - the smallest a room can be, e.g. 400.0

• ROOM_SIZE_MAX - the largest a room can be, e.g. 1600.0

• ELAPSED_MILLISECONDS - the number of milliseconds that passed since the last time this formula ran, e.g. 16.6

Tech Support

If you're facing issues running the demo, please send me your log files from this folder. You can reach me via email at mitchell@vercidium.com, via our Discord server, or send me a message here on Patreon.

I've only tested this demo on Windows, but it may run on Linux under Wine/Proton. A native Linux version is on my roadmap, it should be pretty simple now that everything is cross platform (.NET 8, Silk.NET, etc)

Demo V2 Roadmap

This is version 1 of the demo and is missing a few features like Deaf Visualisation.

Version 2 of the demo will be released some time this week and will contain:

• Deaf visualisation

• Ambient directions - they aren't working correctly in V1, they seem to drop off very quickly when entering buildings

• Microphone input - hear your voice in the current environment

• Custom sound files (MP3/WAV/OGG)

• More variables to adjust - ray count, max bounces, etc

• Ability to change sample rate. Currently it's forced to 48000Hz

• View all reverb parameters in real time (decay, delay, density, diffusion, etc)

• Ability to create custom reverb presets

Godot Roadmap

• The last two weeks - create an interactive Raytraced Audio demo that lets you position sound sources around an environment, tweak the variables and formulas behind muffling/permeation/reverb, and hear the audio update in real time

• Today - release the demo for Patrons, to get early feedback

• Next week - release the demo for testers (those who submitted the sign-up form)

• Next few weeks - create a C# SDK for Raytraced Audio and release it for testers and Patrons

• Next few months - create the Godot plugin, iterate and improve the C# SDK

• Milestone 1 - release the paid Godot plugin

• Next few weeks/months - tech support for Godot devs

Unreal Roadmap

• A couple weeks - Convert C# SDK to C SDK and release it for Patrons and testers to get early feedback

• Next few weeks - iterate and improve the C SDK based on feedback

• Next few weeks/months - create Unreal plugin, iterate and improve the C SDK

• Milestone 2 - release the paid Unreal plugin

• Next few weeks/months - tech support for Unreal devs