Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
daily_activity_dataset_imta_ensta [2021/07/07 13:04] mai hardware |
daily_activity_dataset_imta_ensta [2023/10/02 16:25] (current) mai |
||
---|---|---|---|
Line 18: | Line 18: | ||
===== Data Location ===== | ===== Data Location ===== | ||
- | Recorded on the drive 10To La Cie/dataset. | + | |
- | The folders are organised as : s1/experiment2 for the subjectNumber and recording number | + | The latest working folder is on backup1, in folder DatasetVirtualSmartHome2023, with the reoganisation and renaming of the files by hiParis. |
- | In each folder are files : | + | |
+ | Data before renaming is in backup1, folder DatasetVirtualSmartHome2021. | ||
+ | Original data with xaal data is in dataset_avecxaal and dataset_2021.tar.gz. | ||
+ | |||
+ | |||
+ | The dataset was first recorded on the drive 10To La Cie/dataset. The folders are organised as : s1/experiment2 for the subjectNumber and recording number. | ||
+ | |||
+ | ==== DatasetVirtualSmartHome2023 Folder content ==== | ||
+ | |||
+ | * Folder Code2020_by_TP/Vhome-doc : contains a documentation for virtual home simulator | ||
+ | * Folder Code2020_by_TP/LivraisonVSHome/Projet_code : contains the code for bluring faces in videos, drawing the skeletons, renaming the files and folders. and for the simulator Virtual Smart Home | ||
+ | * Folder codeRecordingDataset is a copy of the code used to record the dataset, from https://github.com/dbouchabou/Experiment_HAAL_dataset | ||
+ | * Folder config_xsens contains the measurements of the subjects skeleton for x-sens. | ||
+ | * Folder VirtualHome contains by sensor modality the data for each subject and each experiment : | ||
+ | * IOT : xaal data | ||
+ | * IR: the infrared cameras : small resolution and Optris. Currently the content is only symbolic links to the contents in DatasetVirtualSmartHome2021 | ||
+ | * Skeletons : x-sens and kinect, but also the processed openpose. | ||
+ | * Videos : RGB anonymised videos. There are also videos with audio and fisheyecamera videos that have not yet been added. | ||
==== Documents describing the dataset ==== | ==== Documents describing the dataset ==== | ||
+ | |||
+ | The folder https://drive.google.com/drive/folders/1D2UvNDFBL7e-PAb0IffjIEFkR9oYmkTK?usp=drive_link contains information about how the dataset was designed and recorded, including : | ||
* list of all recordings are on the document DatasetRecordings2021Log https://docs.google.com/spreadsheets/d/1W0DqjJVarbkoAUHT3j2Q7lVogSw5QohR092B2tZ4iks/edit?usp=sharing | * list of all recordings are on the document DatasetRecordings2021Log https://docs.google.com/spreadsheets/d/1W0DqjJVarbkoAUHT3j2Q7lVogSw5QohR092B2tZ4iks/edit?usp=sharing | ||
* Rules for the setup and design of the recording sessions https://docs.google.com/document/d/17Z-UU5QdpVliK1zFvtqa-svI1SIBw9suLfvPhSxTlKE/edit?usp=sharing | * Rules for the setup and design of the recording sessions https://docs.google.com/document/d/17Z-UU5QdpVliK1zFvtqa-svI1SIBw9suLfvPhSxTlKE/edit?usp=sharing | ||
- | * The scripts to launch and synchronise all activities are on https://github.com/dbouchabou/Experiment_HAAL_dataset | + | * The scripts to launch and synchronize all activities are on https://github.com/dbouchabou/Experiment_HAAL_dataset |
+ | * Folder Illustrations contains pictures of the setup with the position of the Kinect. | ||
==== Recording procedure ==== | ==== Recording procedure ==== | ||
- | describe how we launch the scripts, which programs to open, OS requirement | + | describe how we launch the scripts, which programs to open |
=== Set up the hardware === | === Set up the hardware === | ||
+ | |||
Computers : | Computers : | ||
* A linux computer with USB 3 (for the Optris IR camera) with | * A linux computer with USB 3 (for the Optris IR camera) with | ||
Line 48: | Line 71: | ||
* Plug the Optris IR Camera with USB 3 on computer1 with ROS. | * Plug the Optris IR Camera with USB 3 on computer1 with ROS. | ||
- | * The Flir IR Camera is connected to the smart home system and can be streamed via the network with RJ45. For instance, ffmpeg can record the stream into a file with the command ffmpeg -i rtsp://xaal-c.enstb.org:8554/flir1 filename210701.mp4. | + | * The Flir IR Camera is connected to the smart home system and can be streamed via the network with RJ45. For instance, ffmpeg can record the stream into a file with the command ''ffmpeg -i rtsp:/// ///xaal-c.enstb.org:8554/flir1 filename210701.mp4''. |
* The Kinect v2 360 is connected via USB 3 to the ZED computer with windows and Microsoft Kinect Studio installed. | * The Kinect v2 360 is connected via USB 3 to the ZED computer with windows and Microsoft Kinect Studio installed. | ||
* The FishEye camera is connected via wifi and can be streamed via the network. | * The FishEye camera is connected via wifi and can be streamed via the network. | ||
Line 55: | Line 78: | ||
=== Launch the programs === | === Launch the programs === | ||
+ | |||
+ | |||
+ | - Move the previous recordings to the right folder | ||
+ | - Move xsens recording .mvn file from folder Desktop/Xsens/ to the folder dataset/subject_tmp | ||
+ | - Move the folder dataset/subject_tmp to /dataset/sN so that the data does not get erased | ||
+ | - Create folder dataset/subject_tmp | ||
+ | - Push on button ''Start'' | ||
+ | - To end, push on button ''Stop'' | ||
+ | |||
==== Post-processing procedure ==== | ==== Post-processing procedure ==== | ||
=== Kinect data === | === Kinect data === | ||
+ | *<code>xefextract.exe "path_to_file.xef"</code> | ||
+ | *On utilise le code de github <https://github.com/Isaac-W/KinectXEFTools>. | ||
+ | *S'on ne pourrait pas avoir le bon resultat, on pourrait modifier le code dans "\examples\XEFExtract\XEFWriters" et utiliser le bulid bat comme "build_win10-x64.bat" dans "\examples\XEFExtract" pour le compiler. | ||
=== X-sens data === | === X-sens data === | ||
+ | *On exporte le fichier xxx.mvnx, donc on pourrait le porgrammer. | ||
=== IR camera data === | === IR camera data === | ||
+ | *C'est déjà fait dans le ROS | ||
=== xaal data === | === xaal data === | ||
Line 73: | Line 110: | ||
* ffmeg on windows computer ZED does not work well | * ffmeg on windows computer ZED does not work well | ||
+ | ===== Avant l'enregistrement ===== | ||
+ | |||
+ | * Les ordinateurs doivent être au maximum connecté en Ethernet | ||
+ | * Activer l'environnement python xaal, ouvrir dans powershell et exécuter : .\xaal_env/Scripts/activate | ||
+ | * Exécuter ces 2 commandes dans 2 fenêtres de terminal différentes : | ||
+ | * roscore | ||
+ | * roslaunch optais_drivers optais_drivers.launch | ||
+ | * rosrun optais_drivers camera.py, s'on veut démarrer le caméra Optris tous seule | ||
+ | * Lancer les scripts : | ||
+ | * python xaal_btn_base.py | ||
+ | * python xaal_activity_fish_eye.py : vérifier que le path du script correspond à l'ordinateur utiliser | ||
+ | * python xaal_activity_IR_cams.py | ||
+ | * python xaal_activity_kinect_xsens.py (à lancer dans l'ordinateur avec la kinect studio et xsens studio) | ||
+ | |||
+ | |||
+ | |||
+ | * Porter les capteurs Xsens avec du sparadra pour pas que ça bouge pendant les scénarios | ||
+ | * Faire le calibrage dans l'angle de l'entrée du LivingLab pour la position absolu pour Xsens. | ||
+ | |||
+ | * Ne pas commencer à enregistrer (appui sur bouton start), si tous les capteurs ne sont pas dans l'état souhaité. Exemple : capteur de mouvement D-Room - attendre 180 secondes pour qu'il revient à l'état False) | ||
+ | |||
+ | |||
+ | ===== Pendant l'enregistrement ===== | ||
+ | |||
+ | * Dire à haute voix ce que l'on va faire avant de le faire et attendre un retour par ses collègues que l'appui sur le bouton d'activité est fait | ||
+ | * Faire attention aux dalles mortes (cuisine/salle de bain : trop proche de la fenêtre ou trop proche des meubles/frigo) | ||
+ | * Dans le fauteuil et dans le lit : bien s'asseoir et vérifier sur l'écran Graffana que le capteur de pression est bien activé | ||
+ | * Ne pas allumer les plaques en même temps que le four, car cela fait sauter les plombs | ||
+ | |||
+ | |||
+ | ===== Après l'enregistrement ===== | ||
+ | * Fermer Kinect Studio | ||
+ | * Renommer subject_tmp par le nom de dossier experiment souhaité et déplacer le dossier dans le dossier du sujet | ||
+ | * Déplacer le fichier mvn (C://Users/zed/Desktop/Xsens) dans le dossier du sujet (E://dataset/) : s1, s2, s3 .. | ||