Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 165편

Holistic Evaluation of Language Models

HELM
HELM 설명 보기

The Holistic Evaluation of Language Models (HELM) is a comprehensive framework developed by Stanford University for evaluating foundation language models. It serves as a living benchmark, promoting transparency in language models. Here are the key aspects of HELM: Purpose: HELM aims to provide a holistic view of language models by considering various dimensions and metrics. Coverage: It encompasses a wide range of scenarios and recognizes the inherent incompleteness of existing models. Metrics: HELM employs multiple metrics to assess language models. Standardization: The framework promotes standardization in evaluation practices. Accessibility: All data and analyses are freely accessible on the HELM website for exploration and study.

관련 논문 1편

HELMET

HELMET 설명 보기

The HELMET dataset contains 910 videoclips of motorcycle traffic, recorded at 12 observation sites in Myanmar in 2016. Each videoclip has a duration of 10 seconds, recorded with a framerate of 10fps and a resolution of 1920x1080. The dataset contains 10,006 individual motorcycles, surpassing the number of motorcycles available in existing datasets. Each motorcycle in the 91,000 annotated frames of the dataset is annotated with a bounding box, and rider number per motorcycle as well as position specific helmet use data is available.