GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformer

AI-generated keywords: Open-source language models

AI-generated Key Points

  • Growing interest in fine-tuning open source language models like LLaMa and InstructUIE for named entity recognition tasks
  • Introduction of GLiNER, a compact NER model trained to efficiently identify any type of entity
  • Leveraging a bidirectional transformer encoder architecture for parallel entity extraction
  • Outperforming traditional LLMs in zero-shot evaluations
  • Comparison with recent models designed for open-type NER tasks using prompting techniques from previous studies
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Urchade Zaratiana, Nadi Tomeh, Pierre Holat, Thierry Charnois

Work in progress
License: CC BY 4.0

Abstract: Named Entity Recognition (NER) is essential in various Natural Language Processing (NLP) applications. Traditional NER models are effective but limited to a set of predefined entity types. In contrast, Large Language Models (LLMs) can extract arbitrary entities through natural language instructions, offering greater flexibility. However, their size and cost, particularly for those accessed via APIs like ChatGPT, make them impractical in resource-limited scenarios. In this paper, we introduce a compact NER model trained to identify any type of entity. Leveraging a bidirectional transformer encoder, our model, GLiNER, facilitates parallel entity extraction, an advantage over the slow sequential token generation of LLMs. Through comprehensive testing, GLiNER demonstrate strong performance, outperforming both ChatGPT and fine-tuned LLMs in zero-shot evaluations on various NER benchmarks.

Submitted to arXiv on 14 Nov. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2311.08526v1

, , , , In recent research efforts, there has been a growing interest in fine-tuning open source language models like LLaMa and InstructUIE for named entity recognition tasks. These approaches have shown promising results, but also have limitations that need to be addressed. This paper introduces GLiNER, a compact NER model trained to efficiently identify any type of entity. Leveraging a bidirectional transformer encoder architecture, GLiNER enables parallel entity extraction and outperforms traditional LLMs in zero-shot evaluations. Additionally, the study compares GLiNER with recent models designed for open-type NER tasks using prompting techniques from previous studies. By addressing key limitations and showcasing strong performance results, GLiNER stands out as a promising solution for efficient and effective named entity recognition in natural language processing applications.
Created on 22 Mar. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.