TransformerRanker

TransformerRanker automatically finds the best-suited LM for your NLP task!

TransformerRanker

The problem: There are (hundreds of) thousands pre-trained language models (LMs) available - but which one is the best for your NLP task?

The solution: TransformerRanker!

TransformerRanker automatically selects the best LM for your task. Simply input a 🤗 Dataset and a list of candidate LMs. TransformerRanker will then quickly rank them for the task.

TransformerRanker implements state-of-the-art methods for transferability estimation, so no costly fine-tuning of LMs is needed. This makes the library very fast, allowing you to rank dozens of LMs.

Getting Started

• Check out the github page
• Check out our tutorials!

Publications

TransformerRanker: A Tool for Efficiently Finding the Best-Suited Language Models for Downstream Classification Tasks.Lukas Garbas, Max Ploner and Alan Akbik.

Choose Your Transformer: Improved Transferability Estimation of Transformer Models on Classification Tasks.Lukas Garbas, Max Ploner and Alan Akbik. ACL 2024.