Evaluation Scope
Cross-source consensus on Evaluation Scope from 1 sources and 5 claims.
1 sources · 5 claims
Uses
Preparation
Risks & contraindications
Evidence quality
Highlighted claims
- The evaluation used STS-B, QQP, and five BEIR retrieval datasets. — LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference
- The method is designed for embedding-level tasks rather than token-level exit tasks. — LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference
- Validation is limited mainly to English sentence similarity, BEIR retrieval, and 12-layer backbones. — LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference
- Token-level tasks would need a different exit statistic or task-specific exit heads. — LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference
- Specialized domains may need held-out validation and threshold recalibration before deployment. — LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference