This is an old revision of the document!
Daily Activity Dataset recording
with Ensta
Sensors :
- Kinect 360 v2
- Optris IR camera
- Flir IR Camera
- xsens
- FishEye camera
- smarthome sensors
- sensefloor to detect localisation wrt each room
- motion sensors for each room
- opening/closing cupboards
- lights
- power consumption of stove, oven, boiler, plugs, tv
- pressure sensor for bed, sofa
Data Location
Recorded on the drive 10To La Cie/dataset. The folders are organised as : s1/experiment2 for the subjectNumber and recording number In each folder are files :
Documents describing the dataset
- list of all recordings are on the document DatasetRecordings2021Log https://docs.google.com/spreadsheets/d/1W0DqjJVarbkoAUHT3j2Q7lVogSw5QohR092B2tZ4iks/edit?usp=sharing
- Rules for the setup and design of the recording sessions https://docs.google.com/document/d/17Z-UU5QdpVliK1zFvtqa-svI1SIBw9suLfvPhSxTlKE/edit?usp=sharing
- The scripts to launch and synchronize all activities are on https://github.com/dbouchabou/Experiment_HAAL_dataset
Recording procedure
describe how we launch the scripts, which programs to open
Set up the hardware
Computers :
- A linux computer with USB 3 (for the Optris IR camera) with
- xaal installed
- a Windows computer with USB 3 (for the Kinect v2 360) with
- Microsoft Kinect Studio
- MVN Studio Biomech
- a macos computer to record the videos via the network (ffmpeg)
Pluging of the sensors :
- Plug the Optris IR Camera with USB 3 on computer1 with ROS.
- The Flir IR Camera is connected to the smart home system and can be streamed via the network with RJ45. For instance, ffmpeg can record the stream into a file with the command
ffmpeg -i rtsp:/ /xaal-c.enstb.org:8554/flir1 filename210701.mp4
. - The Kinect v2 360 is connected via USB 3 to the ZED computer with windows and Microsoft Kinect Studio installed.
- The FishEye camera is connected via wifi and can be streamed via the network.
- The power, pressure, door, motion detectors are connected via xaal
- The x-sens hub is connected via usb to the ZED computer with windows with MVN Studio Biomech installed
Launch the programs
- Move the previous recordings to the right folder
- Move xsens recording .mvn file from folder Desktop/Xsens/ to the folder dataset/subject_tmp
- Move the folder dataset/subject_tmp to /dataset/sN so that the data does not get erased
- Create folder dataset/subject_tmp
- Push on button
Start
- To end, push on button
Stop
Post-processing procedure
Kinect data
X-sens data
IR camera data
xaal data
Troubleshooting
- ffmeg on windows computer ZED does not work well