DeepLabCut 在大空间追踪小型动物的评估与入门指南
Evaluation and primer for using DeepLabCut to track small animals in large spaces
一项预印本研究评估了 DeepLabCut(DLC)在大空间中追踪远小于以往验证数据目标的小型动物时的表现,并给出术语与工作流入门说明。作者测试了 36 种模型配置,覆盖三种训练比例、六种训练迭代和两种录制分辨率,从训练收敛、预测误差、预测置信度和泛化性四方面评估;测试帧中高分辨率下 18 种配置有 15 种、低分辨率下有 6 种满足全部性能标准。
DeepLabCut (DLC), a machine learning-based pose estimation tool, has dramatically increased the throughput of behavioral tracking. Yet its implication remains limited by lack of validation data from diverse scenarios and users' unfamiliarity with the machine learning workflow. Here, we provide a practical primer on DLC terminology and workflow and performance evaluation of DLC in a novel scenario where the target is much smaller than those in previous validation data. We assessed model performance in a total of 36 model configurations across three training proportions, six training iterations, and two recording resolutions. Performance was evaluated on training convergence, prediction error, prediction certainty, and generalizability. Additionally, we selected an optimal model based on a balance between model performance and training time and applied it to 20 recordings at each resolution. In the test frames, 15 and 6 out of 18 model configurations met all performance criteria under high- and low-resolution, respectively. Of these, DLC was able to achieve low prediction error, high prediction confidence, and low train-test loss. Prediction error and confidence varied with training proportion, iteration, and resolution. Inference using the optimal models achieved similar high confidence predictions, with low-likelihood predictions predominantly associated with visual obstruction, low light, and reduced contrast between the subject and the background. Notably, the optimal models for high- and low-resolutions performed similarly despite a multi-fold difference in the cost of the recording devices, providing validation data for DLC in low-budget research, teaching and outreach scenarios.
中文翻译还没有生成,先显示原文。
来源:bioRxiv · Animal Behavior and Cognition · biorxiv.org