gpt-score: 3.27
Papers with Code · CC BY-SA 4.0
Video-based Generative Performance Benchmarking
The benchmark evaluates a generative Video Conversational Model and covers five key aspects:
- Correctness of Information
- Detailed Orientation
- Contextual Understanding
- Temporal Understanding
- Consistency
We curate a test set based on the ActivityNet-200 dataset, featuring videos with rich, dense descriptive captions and associated question-answer pairs from human annotations. We develop an evaluation pipeline using the GPT-3.5 model that assigns a relative score to the generated predictions on a scale of 1-5.
논문
gpt-score: 3.51
gpt-score: 3.46
gpt-score: 2.30
gpt-score: 3.57
gpt-score: 3.01
gpt-score: 3.85
gpt-score: 2.62
gpt-score: 2.16
gpt-score: 2.53
gpt-score: 3.40
gpt-score: 3.60
gpt-score: 3.48
gpt-score: 3.23
gpt-score: 3.55
gpt-score: 3.27