{"id":881,"date":"2017-12-01T17:21:28","date_gmt":"2017-12-01T16:21:28","guid":{"rendered":"http:\/\/jmladeno.net\/?p=881"},"modified":"2018-05-07T15:56:43","modified_gmt":"2018-05-07T13:56:43","slug":"sync-data-from-unity-vr-and-physiology","status":"publish","type":"post","link":"https:\/\/jmladeno.net\/index.php\/2017\/12\/01\/sync-data-from-unity-vr-and-physiology\/","title":{"rendered":"Sync Unity and physiology"},"content":{"rendered":"

Let’s say you want to record the position of a ball or whatever gameObject you use in Unity.
\nOr if you are using VR — you wish to stream the position\/rotation of the head and controllers while in VR.
\nAlso, at the same time you are measuring some physiology, e.g., the galvanic skin response (GSR) or EEG.
\nDuring the experiment, you have certain triggers\/events, also called Markers, that you also want to keep track of…<\/p>\n

You wish to sync everything together? Well, my advice is use Lab Streaming Layer (LSL)<\/a><\/p>\n

Why LSL?<\/h4>\n

It is easy<\/strong> to implement in many languages and easy to use.
\nIt can sync<\/strong> many data automatically, meant for physiological recording.
\nIt handles multiple machines<\/strong> at the same time with high precision<\/strong>, so one could sync even ERPs.
\nAnd no need for ip<\/strong> addresses anymore when communicating between machines.
\nIt works on Local Network as well as WAN
\n(I advise you use a local router or hub to avoid interference)<\/p>\n

Most importantly, when using LSL, make sure you have DEACTIVATED FIREWALL<\/strong> for Unity and Openvibe and other apps in use!!!<\/p>\n

1. For offline analysis :<\/h4>\n

One can record all data in an .xdf file with the Lab Recorder<\/a>,
\nand analyze offilne in Matlab for example, with eeglab<\/a> or other toolboxes.<\/p>\n

2. Online processing:<\/h5>\n

You can use openvibe<\/a> which has LSL already integrated,
\nor Simulink<\/a> (working on it)! tutorial soon…<\/p>\n

 <\/p>\n

How To:<\/h5>\n

1. download LSL4Unity<\/a> (this is a modified version from the original xfleckx<\/a> )
\n2. download latest Lab Recorder<\/a>
\n3. download Unity<\/a>,
\nyou would need to have a game already made:
\ne.g., Rolling A Ball<\/a> — from the Unity tutorial,
\nor if you do VR, you would need an environment ready to use,
\nfor HTC Vive for example: from htc-vive-tutorial-unity<\/a>
\n4. For this tutorial Windows 7+ is needed (I tested on windows 10)<\/p>\n

Once you have downloaded and unzipped all the folders,
\nI advice you to follow the nice tutorials for Unity before using LSL.<\/p>\n

Make a copy of the Unity project you intend to use and rename it
\ne.g., Roll_a_Ball-LSL (to keep your original project without lsl).
\nThen copy the LSL4Unity folder in the Assets folder from your Unity project.
\nSo when you enter your project in Unity it looks like this:<\/p>\n

\"\"<\/p>\n

Send data streams from Unity :<\/h3>\n

(Send data streams to Unity – bellow.)<\/p>\n

Send streams from Unity<\/h5>\n

such as position, rotation of the gameObject or of head and controllers<\/em>,<\/p>\n