MAGES SDK 5¶
MAGES SDK 5.3.5 (NXT) - Late June 2025¶
Mesh Deformations: Optimized the handles drawing in the particle editor
Mesh Deformations: Added new option in the Scene View overlay to toggle the visibility of constraints
Mesh Deformations: Added new option in the Scene View overlay to set the maximum particle draw count
Mesh Deformations: Added new option in the Scene View overlay to set the particle draw scale
Mesh Deformations: Added new visual in the Scene View overlay that shows the last selected particle
Mesh Deformations: Added some new options in the GameObject menu to easily create components for the mesh deformations module.
Mesh Deformations: Updated documentation for various actors and joints
Fixed an issue where the Choice Action with undo does not get initialized
Fixed an issue where the Ghost Object in the Insert Action would show as duplicate over the lerping object.
Fixed an issue where the Hub would not indicate that a core module is missing and would result in erroneous errors & behavior
Fixed an issue where the Tetrahedral Mesh Importer would fail without error when importing an MSH file with improper formatting.
Fixed an issue where the Place Action would not perform in Single Player
MAGES SDK 5.3.4 (NXT) - June 2025¶
Hub: Improved URP configuration in Setup
Scene Graph: Removed Perform/Undo audio for logic actions where it did not make sense
JARIA: Added support for VR Gameplay Assistant Agents
JARIA: Made Cancel function public
Interaction: Exposed palm ray options to fine tune interaction radius and ease
Interaction: Added interaction priority
Interaction: Added an option to the grab mode which moves both the interactor and the interactable closer to one another
Interaction: Added ability to force the raycasts on and off
Documentation: Added deprecation list
Documentation: Updated class reference
Recorder: Improved interpolation of transforms
Recorder: Added UpdatePhase to interface
Scene Graph: Allow for multiple decision objects in Choice Action
Scene Graph: Allow for multiple buttons in Click Action
Scene Graph: Allow for requiring the object to be grabbed in Insert Action
Networking: Added Interaction Network Events to receive callbacks when objects are interacted with by other players
Feature: Exposed Generic IK in experimental
Fixed an issue where the delay action could not be performed in under 0.7 seconds
Fixed an issue where the Select and Or nodes when performed would undo other actions that are not performed
Fixed an issue where the GraphRunner wouldn’t check if an action is not uninitialized in order to undo it in some cases
Fixed an issue where the keyboard in login panel would remain unfocused in Android builds
Fixed an issue where the trigger colliders would not be grabbable
Fixed an issue where the Repeat Action would not work properly in co-op
Fixed an issue where JARIA threw an error with speech to text
Fixed an issue where the Hand Pose Editor window would not open the second time
Fixed an issue where the interaction manager processing order was incorrect
Fixed an issue where the hover material would remain when used with Ghost
Fixed an issue where the SpawnStep was not saving references
Fixed an issue where the raycasts of players would be shown in recordings
Fixed an issue where the order of Undo events was not adhered to
Fixed an issue where the sync transform mode would not be applied properly in Co-op
Fixed an issue where the co-op player could perform the Place Action without letting go of the object
Fixed various issues in Mesh Deformations module
Fixed various issues in JARIA Agents
Fixed various issues with ManagedObjects in Scene Graph
Fixed various issues with re-initializing the XR loader
Fixed various issues with gamification patterns in corner cases
MAGES SDK 5.3.3 (NXT) - February 2025¶
Added option for JARIA Agents to receive text-based requests from code rather than user voice input
Added option for JARIA Agents to filter the response before voice generation
Fixed an issue where Group and Repeat Action nodes would not be properly serialized leading to data loss or scene graph connectivity issues
Fixed an issue where the Character Controller module was not enabled when animation rigging was imported
Fixed an issue where trying to create reroute node while not logged in resulted in null reference exception
Fixed an issue where renaming the Group action would not result in the name changing
Fixed an issue where placing 2 or more Group actions would break the scene graph
Fixed an issue where deleting a Group or Repeat action would not delete the connections as well
Fixed gizmos in rotation axis monitor to appear on object position
Fixed incorrect angle measurement in Rotation Action (RotationAxisMonitor)
Fixed some features of MAGES Character Controller not working on builds
MAGES SDK 5.3.1 (NXT) - February 2025¶
Added automatic hand pose generation for runtime
Added ability to interact with colliders designated “trigger”
Added new & optimized VR Whiteboard implementation
Added option to use scene path in click action
Reworked Localization inspector to increase performance
Fixed an issue where networked paths for GameObjects not in Resources would be recorded into the table before play mode or builds
Fixed an issue where the reroute node would not function properly after first perform passed
Enabled hands to show on Mobile driver
Fixed an issue where events regarding Scene Graph could not be unhooked
Various improvements for Mesh Deformations
Fixed an issue with the hand tracking system when changing scenes non-additively
Fixed various issues with Rotate Action axes and runtime behavior
Fixed an issue where sometimes the Initialize steps of an action were called before the Perform steps of the previous action
MAGES SDK 5.3.0 (NXT) - Mid December 2024¶
Device Manager V2: A new version of the device manager that can automatically detect, and enable cameras
There’s no more need to manually select which device to use during build, additionally, in the editor, the device manager will automatically switch to and from XR depending on whether the user has the device on
Introduced Driver API, which allows for custom device creation
Introduced Spawn Point component, which will correctly configure height of devices, and in the future, will be used to determine where network players spawn
MR Support: Added support for toggling AR as well as an easy way to declare that a gameobject should be hidden in AR mode (see here)
Collision Sound Module: Added a new module that allows you to play sounds when objects collide with each other
Remove range restriction on Activate Action
Added tool to easily create prefabs from handposes (primarily for making ghosts)
Added Rotate Action (rotate an object x turns to perform)
Added Place Action (move object or self to an area to perform)
Added option to use animator for Impact Action
Added an automatic quality settings configuration task which will set the quality settings to some good defaults for standalone XR applications
Fixed an issue where using reflection to load classes which could not be loaded would result in error
Fixed an issue with the select action not working properly in network during undo
Fixed an issue where logic actions would play perform/undo sounds
Fixed an issue with the hand poser where automatic hand poses would not work in editor
Fixed some performance issues in Analytics module
Fixed some issues with Undo on neuromonitoring sample
If you experience compiler errors after updating, make sure to check and remove the “MAGES_MICROSOFT_COGNITIVE_SERVICES” scripting define under Project Settings -> Player -> Script Compilation and delete the TokenPreload generated script in the Assets folder.
MAGES SDK 5.2.7 (NXT) - December 2024¶
Added option to send haptic feedback in Trajectory Action while the user is following the trajectory
Added alphabetical ordering to analytics editor actions
Added option to configure the reset pose of a grabbable through code
Added option to option to toggle collisions based on the interactor type
Added option to send haptic feedback in Use Action while the user is interacting with the object
Added option in CameraFadeEffect to allow custom fade values
Added option in CameraFadeEffect to cancel it through code
Fixed an issue with the AI Agents where recognition wouldn’t trigger if the input was too unclear
Fixed an issue where various conditionally applied modules wouldn’t load or be stripped by the linker
Fixed an issue with the MAGES Panel where outdated samples wouldn’t be shown as such
Fixed an issue where the developer authentication would fail when entering play mode or building the project
Fixed an issue where the microphone wouldn’t record in iOS
Fixed an exception in Storyboard Generator that was thrown when the submit button was pressed
Fixed various handpose editor fixes regarding serialization
Fixed an issue where multiple Ghost components would result in the object not having the ghost effect
Fixed an issue where the CameraFadeEffect.FadeOut would not work properly
Fixed an issue where the Recorder would block the main thread while fetching/download/uploading recordings
If you experience compiler errors after updating, make sure to check and remove the “MAGES_MICROSOFT_COGNITIVE_SERVICES” scripting define under Project Settings -> Player -> Script Compilation and delete the TokenPreload generated script in the Assets folder.
MAGES SDK 5.2.6 (NXT) - Mid November 2024¶
Added AI Agents: A new module that lets you create AI agents that can instruct and interact with the user (see here).
Added option to remove collisions for hand tracking.
Added option to disable the ghost effect on game objects if an interactor is hovering them.
- Added option to use XR_FB_hand_tracking_aim extension for hand tracking UI interaction. This significantly improves the UI experience for devices that support this extension.
- Confirmed devices
Meta Quest 3
Meta Quest 2
Added Storyboard Generator: A JARIA module that allows you to create a storyboard from large texts.
Fixed some missing references in samples
Fixed an issue where the delay action would perform even after the scene was in edit mode and the next action would be initialized, spawning objects and throwing errors in Editor Mode.
Fixed an issue where the final prefab of an Insert Action would not be always destroyed when the action was performed and the destroy on perform flag was set.
Fixed an issue in the Mobile3D camera where teleporting would not override its rotation properties properly.
Fixed an issue where reordering steps in the scene graph would be updated incorrectly on the serialized object representation.
Fixed an issue where multiple Managed Objects would incorrectly be handled/invoked and thus resulting in actions overstepping on another, when they are re-entered.
Fixed an issue where the choice action would have multiple output ports
Revised design on MAGES Panel to better fit small laptop screens
Fixed an issue where playback UI wasn’t easy to click with hand tracking
Fixed an issue where the remove action would not make objects kinematic
Fixed some performance issues with the interaction system
Fixed some performance issues with the neuromonitoring scene
Adjusted hand tracking gesture recognition retainment threshold to feel more snappy
Fixed some performance issues with the analytics computation at the end of a session
MAGES SDK 5.2.5 (NXT) - Mid October 2024¶
Minor adjustments to styling in MAGES Panel
Added text wrap in configuration task section
Use Action - Ghost: Added ability to spawn multiple override ghost prefabs with specified parents.
Activate Action: Added option to configure haptic feedback strength
Added Group Action
- Added self avatar visibility feature
Self avatar is only visible for cameras that draw with the avatar layer
Added ability to Import/Export CSVs with the Localization module.
Tool Interactor now works without assigning poses
Added Interaction Layers (used to specify which objects can be grabbed by which tools/hands)
Fixed scrollbars not displaying in MAGES Panel
Fixed ‘Spline Zipper’ issue
Fixed Use Action Editor to use floating point values (and slider) instead of int values
Fixed issue in ghost effect where it wasn’t getting destroyed
Fixed an issue where selecting an object with the other hand would cause it to be flung
Fixed an issue in coop where grabbables with parents weren’t synchronizing correctly.
Fixed a build error in iOS/VisionOS where the analytics/dissonance module where not being loaded correctly.
Fixed an issue with GameObjectSpawner.DestroyActionObject not looking for prefab instances if passed an “asset” prefab.
Fixed an issue with MAGES Panel Extras not downloading properly.
Fixed an issue with touch devices and the login UI.
Fixed Grabbable component editor error when left and right hand interactors weren’t assigned in the bundle.
Fixed several issues with the hand poser editor
Fixed a runtime analytics error when using SceneGraphModule.Reset
MAGES SDK 5.2.3 (NXT) - October 2024¶
Scene Graph: Added two new actions, Impact and Delay
Scene Graph: Added a utility to reroute connections between nodes
Gamification Patterns: Added option for custom prefab to spawn as ghost for the Use Action
Interaction: Added ability to grab tools with other tools via the Tool Interactor component
Analytics: Added an objective extension to check for “Must Collide” instances
Mesh Deformations (Experimental): Added a new feature that lets you deform meshes in real-time. This feature is still experimental and may have some issues
Character Controller (Experimental): Added the character controller framework to easier manage and randomize multiple animations which can bring more life to your characters
VAPPS (Experimental): You can now download our own high fidelity model of a human. This is still in progress and the model was designed to have the highest possible fidelity, so take care not to tank the performance of your SIMs
Hand Tracking: Fixed an issue where the hand was not in the correct position while grabbing items
Hand Tracking: Fixed an issue where auto attach grabbable items sometimes did not show up in Co-Op
Experimental: Fixed an issue where the Click Action pattern was not fully functional; when pressing multiple times, the action was performed multiple times
Scene Graph: Optimized save and load times for large scene graphs
Interaction: Fixed a serialization issue in the hand poser
Recorder: Fixed an issue where analytics interpreter would throw an exception when writing to the XREC file
Recorder: Fixed an issue where opening the Packet Explorer would throw an exception and display an empty window
WebGL: Fixed an issue where the exporter would fail due to Unity’s Microphone API not being supported on the platform. Created a custom implementation instead.
In the latest update of Unity, there are some errors shown with the Spline Zipper component.
MAGES SDK 5.2.2 (NXT) - September 2024¶
Update to Unity version 2022.3.x
Added better TextMeshPro presets for Liberation Sans: Normal, Outline, Overlay, Outline Overlay
XR Recorder: Added full analytics playback. Now notifications shown during the recording are also shown during the playback
Hand Tracking: Added Hand Tracking support for XR Hands
Scene Graph: Added Reset() method which reverts the scene graph to its initial state
Scene Graph: Added Or and Select nodes
Added Migration assistant to help migrate projects from MAGES SDK 5.1.0 to 5.2.1
Fixed Notification, Option, and XR Recorder playback UIs not being displayed over objects correctly.
Fixed various minor issues in Analytics module
Fixed an issue with the Device Manager if the XR Management plugin is not installed
XR Recorder: Fixed an issue when fetching cloud recordings
XR Recorder: Fixed an issue when attempting to find the recording duration from a local file.
XR Recorder: Fixed an issue during playback for the Mobile3D camera, where the user could not interact with the playback UI.
XR Recorder: Fixed an issue when closing a recording and restarting, which resulted in a wrong camera rig configuration.
Hand Tracking: While grabbing items, sometimes the hand may not be in the correct position
Hand Tracking: Auto attach grabbable items sometimes will not show up in Co-Op
Experimental: The Click Action pattern is not fully functional; when pressing multiple times, the action will be performed multiple times
Scene Graph: When the scene graph resets, all subscribers to scene graph events must re-subscribe. For this a callback has been added temporarily
Networking: SyncTransformPhoton for large counts og objects (~600+) may cause increased bandwidth usage.
In the latest update of Unity, there are some errors shown with the Spline Zipper component.
MAGES SDK 5.1.0 (NXT) - May 2024¶
Added Choice Action pattern. A new pattern that lets you navigate the user into multiple paths depending on their actions
Added XR Recorder, a new module that lets you to record sessions and replay them in VR
Added localization module. You can choose between multiple languages in your XR apps and configure them through our interface
Added MAGES User Authorization. A new module that lets you to ask for credentials (login and password) when the users enter your MAGES application
Added Analytics uploading. You can now upload your analytics in the ORamaVR portal or through your custom Web API
Added a new sample application, the Neuromonitoring scene. A psychomotor medical simulation with new Actions and MAGES features
Improve the Vaccine sample app (scene updates, patient update and new lighting)
Released our cloud services including sample apps for you to host in your servers. This lets you build your own login, analytics upload and portal services
Updated UI notifications with queues
Auto attach feature to grab objects without pressing any button but based on the distance
Added OptionsUI when the user clicks the right thumbstick or the “O” key. This UI lets the user to perform, undo, repeat the simulation, stop the recording and exit the simulation.
Added haptics/vibration to device manager. Make it easy to call pulses with a single line
Added Choice Action example to the example scene
Added drag and drop icons in the Repeat and Group nodes to make it obvious that you need to drop Actions there.
Added error type text in pop up title
Fixed issue that appears when the Character Customization Prefab is not set, the scenegraph won’t be executed
The action script events were only called once, and not after the action is re-performed or something similar
Fix graph runner not properly calling action events on action scripts
Fix error when accessing destroyed objects in prefab management
Fixed cant find PropertyField because using UnityEditor.UIElements is missing
The InputController field is not visible (in normal editor mode) in DeviceManagerModuleEditor. In order to assign it now I must go to Debug Mode. We fixed this
Fixed new trajectory line button not showing
Fix locomotion can not be disabled
Added missing tooltips in Scengraph editor (nodes)
Fixed network hands issue where it was necessary to use different prefabs for HandInteractors and Network Hands
When the Neuromonitoring sample is imported, 13 warnings are popped in the console
Many warnings were thrown in case a scenegraph was open that did not correspond to the open scene and the project was closed and reopened
They raycast logic will be improved in the following version. Currently the user may close the raycasts by pressing the thumbstick button and can interfere with an action that needs them (QuestionAction)
When you skin in coop (server side) clients get 100% score for the skipped actions.
MAGES SDK 5.0.2 (NXT) - February 2024¶
Fixed issue with end of session analytics not showing on the Empty Scene
Fixed warning that popped when developer selects OpenXR and presses play
Remove MAGES updater that caused issues with the two version of MAGES SDK (assetstore and npm)
Removed missing scripts from network prefabs in empty scene
Remove the functionality that changes the enabled property of the xr rig, since it throws errors
Fixed issue with analytics module that failed to create Settings folder due to path error and runtime analytics cannot be loaded.
Fixed issue with settings asset folder and path not being created correctly.
Fixed bug that caused multiple Unity editor windows popped.
If you remove the avatar customization UI, the scenegraph will not start
More than one scenegraph editors can be active in the Unity editor
If your project does not have any configured analytics, the project report will be set to 0%
MAGES SDK 5.0.1 (NXT) - January 2024¶
Added API Reference in our documentation
The error type remains active through the selection of different Actions (Analytics editor)
Added two extra buttons in the Scenegraph scripts, the Create and Remove. If you press the Create it generates a templated script and attaches is in the field
Added Wrong Answer error type that appears only on QuestionActions. Developers can set the penalty for a wrong answer. The error appears on the analytics report at the end of the simulation
If the user skips a Question Action, the penalty is automatically applied
Fixed issue when switching between Scenes, containing different Scenegraphs, throws multiple errors with both Mobile and XR input
Fixed all the assets that were not oriented correctly
Fixed Analytics paths that were exceeding 140 characters
Fixed all the warnings from the MAGES Panel
Added session restart functionality
Reworked the handling of the MAGES Panel to keep the previous state of the window when developers change tabs
Action names, entered in the Action Pattern Wizard, were not set on the created Action in the Scenegraph window. This is fixed now.
We made sure all the data is saved when moving or hiding the MAGES Panel
Fix NullReferenceException when entering play mode with Scenegraph Tab open
Fixed the issue that caused errors after an assembly reload
“Physics settings are not optimized” Configuration changes were not saved correctly and are reset when the project is closed
Fixed issue when activating a different project as they did not update the information shown in the Advanced Settings
Fixed the error and a warning when entering Play Mode (OpenXR)
We synchronized Destroy On Perform functionality
Rephrased the Label options in the Gamification panel
Fixed the warning regarding LiberationSans
Not stable in Unity 2023.2
The API reference page needs rework to make it more easy to user
After building the app successfully (windows or android) the following error may pop in the console “Shader compiler: Compile Legacy Shaders/Diffuse - FORWARD, Vertex Program: Internal error communicating with the shader compiler process.”
When joining room if no movement occurs the avatar is at the floor (Happens mainly with 3d mobile, since with the HMD is impossible to stay still)
The MAGES Panel remembers the last tab that was opened. If it is the reopened with the last tab being the “Scenegraph Editor”, then both the MAGES Panel and the Scene Graph editor will be created. The scene graph editor will show on top of the MAGES Panel
In coop when you throw the cotton ball in the bin, the following error pops “[NetworkDestroyComponent] Could not find component ArrowGuide in object Cotton_Ball(Clone)
If you add 2 new scenegraph steps and then remove them from first το last the following error pops “Retrieving array element that was out of bounds”
When you skip an Action instead of doing it manually, you get some points. In future update we will set to get zero when skipping an Action. Currently this is only implemented in the Question Action
When you have selected 2 XR providers in the XR management plugin, errors regarding the mobile joystick may appear, stating: “Could not create device with layout ‘Gamepad’ used in ‘OnScreenStick’ component.”
MAGES SDK 5.0.0 (NXT) - December 2023¶
MAGES Panel to configure your MAGES projects
MAGES Hub as the module orchestrator
MAGES Interaction as the module that handles interaction with the virtual objects
MAGES Device Manager to handle the input from the
MAGES Networking to enable collaborative simulations (multiplayer)
MAGES Scenegraph as the module that handles the operation steps (Actions)
MAGES Data Container to store realtime data
MAGES Analytics as the module that manages user performance and errors
MAGES Jaria as an artificial assistant to ask documentation questions
Hand Poser Editor to configure custom handposes for object handling
Example Scene with a simple scenario to explore the basic functionalities
6 new Action patterns (InsertAction, RemoveAction, UseAction, ActivateAction, TrajectoryAction, QuestionAction)
Added scripts and steps to enter custom behavior in our Actions
Gamification patterns to enhance your simulations with gamified elements
Scenegraph wizard to guide users to create their first Actions
Select between XR devices (headsets) and mobile 3D camera (tablets/phones)
Support for IOS and android mobile devices (tablets, phones)
Avatar customization
Added Advanced settings on the MAGES Panel to configure the public parameters of each module
UIs for user to navigate in XR
Minor issues with the developer experience on some Action patterns
When on the “Advanced settings” tab of mages panel and you change bundle, the “Scenegraph” panel opens
Unconnected nodes do not appear in ‘live’ scene graph mode
Saving the scene graph with unconnected nodes, may cause nodes to completely lose their link connections
Trajectory Action is not supported from the Scenegraph wizard
You cannot have more than one Question Action active at the same time (parallel)
Cut, Copy, Paste and Duplicate do not work on the scenegraph editor
Question & incision data editors don’t update their new/edit/save states depending on other changes
When opening the MAGES Panel with a scene graph already open: “Only one instance of the scene graph is allowed”
In some cases the JARIA window is flickering
You cannot press the Exit Button if you do not close the Analytics Tab
Actions do not allow to reference objects from other scenes