This is an old revision of the document!


Daily Activity Dataset recording

with Ensta

Sensors :

  • Kinect 360 v2
  • Optris IR camera
  • Flir IR Camera
  • xsens
  • FishEye camera
  • smarthome sensors
    • sensefloor to detect localisation wrt each room
    • motion sensors for each room
    • opening/closing cupboards
    • lights
    • power consumption of stove, oven, boiler, plugs, tv
    • pressure sensor for bed, sofa

Recorded on the drive 10To La Cie/dataset. The folders are organised as : s1/experiment2 for the subjectNumber and recording number In each folder are files :

Documents describing the dataset

Recording procedure

describe how we launch the scripts, which programs to open

Set up the hardware

Computers :

  • A linux computer with USB 3 (for the Optris IR camera) with
  • a Windows computer with USB 3 (for the Kinect v2 360) with
    • Microsoft Kinect Studio
    • MVN Studio Biomech
  • a macos computer to record the videos via the network (ffmpeg)

Pluging of the sensors :

  • Plug the Optris IR Camera with USB 3 on computer1 with ROS.
  • The Flir IR Camera is connected to the smart home system and can be streamed via the network with RJ45. For instance, ffmpeg can record the stream into a file with the command ffmpeg -i rtsp:/ /xaal-c.enstb.org:8554/flir1 filename210701.mp4.
  • The Kinect v2 360 is connected via USB 3 to the ZED computer with windows and Microsoft Kinect Studio installed.
  • The FishEye camera is connected via wifi and can be streamed via the network.
  • The power, pressure, door, motion detectors are connected via xaal
  • The x-sens hub is connected via usb to the ZED computer with windows with MVN Studio Biomech installed

Launch the programs

  1. Move the previous recordings to the right folder
    1. Move xsens recording .mvn file from folder Desktop/Xsens/ to the folder dataset/subject_tmp
    2. Move the folder dataset/subject_tmp to /dataset/sN so that the data does not get erased
  2. Create folder dataset/subject_tmp
  3. Push on button Start
  4. To end, push on button Stop

Post-processing procedure

Kinect data

X-sens data

IR camera data

xaal data

Troubleshooting

  • ffmeg on windows computer ZED does not work well
  • daily_activity_dataset_imta_ensta.1625664567.txt.gz
  • Last modified: 2021/07/07 13:29
  • by mai