AI summary · arXiv: 1612.03975v2 · cs.CL

ConceptNet 5.5: An Open Multilingual Graph of General Knowledge

Robyn Speer, Joshua Chin, Catherine Havasi
Original paper · DOI 10.1609/aaai.v31i1.11164 Submitted to arXiv on 12 Dec. 2016 Published in Proceedings of the AAAI Conference on Artificial Intelligence (12 Feb. 2017) License: NONEXCLUSIVE-DISTRIB 1.0

How to read this summary? Illustrated guide

The essentials

  • ConceptNet 5.5 is a linked open data resource that enhances machine learning about language.
  • It is designed to be used with modern natural language processing (NLP) techniques like word embeddings.
  • ConceptNet connects words and phrases in natural language through labeled edges.
  • It gathers knowledge from expert-created resources, crowd-sourcing, and games with a purpose.
  • Its primary objective is to represent the general knowledge required for understanding language.
  • Combining ConceptNet with word embeddings provides a deeper level of understanding than distributional semantics or narrower resources like WordNet or DBPedia.
  • The effectiveness of this approach is validated through state-of-the-art results on intrinsic evaluations of word relatedness.
  • This leads to improvements in various applications utilizing word vectors, such as solving SAT-style analogies.

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: ConceptNet Natural Language Processing Word Embeddings Knowledge Graph Distributional Semantics

Read further

  • Comprehensive Summary
  • Layman's Summary
  • Blog article
  • Original abstract
The paper titled "ConceptNet 5.5: An Open Multilingual Graph of General Knowledge" introduces a new version of ConceptNet, a linked open data resource that enhances machine learning about language by providing specific knowledge and external information. This updated version is specifically designed to be used with modern natural language processing (NLP) techniques like word embeddings. ConceptNet is a knowledge graph that connects words and phrases in natural language through labeled edges. It gathers its knowledge from various sources, including expert-created resources, crowd-sourcing, and games with a purpose. Its primary objective is to represent the general knowledge required for understanding language, thereby improving the performance of natural language applications by enabling them to better comprehend the meanings conveyed by people's words. The authors demonstrate that when ConceptNet is combined with word embeddings obtained from distributional semantics models such as word2vec, it provides applications with a deeper level of understanding that cannot be achieved solely through distributional semantics or narrower resources like WordNet or DBPedia. The effectiveness of this approach is validated through state-of-the-art results on intrinsic evaluations of word relatedness, which subsequently translate into improvements in various applications utilizing word vectors. One such application highlighted in the paper is solving SAT-style analogies. In summary, this research presents an enhanced version of ConceptNet that leverages external information and specific knowledge to improve machine learning about language. By combining ConceptNet with word embeddings acquired from distributional semantics models, the authors demonstrate significant advancements in understanding word meanings and relatedness, leading to improved performance in various natural language processing tasks.

Was this synthesis useful?

Score: 1

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Tools for this paper

Explain it differently 3 free rewrites left today
Save to a collection Group papers in collections to compare them, chat with them and export them. Create a free account Log in

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero
Citation alerts Citation alerts guide
Journal club Premium+ Slides to present it

Papers around this one

See them on a map

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Close
    ConceptNet at SemEval-2017 Task 2: Extending Word Embeddings with Multilingual Relational Knowledge
    Robyn Speer, Joanna Lowry-Duda · 2017 · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), p. 85-89 · AI summary available
    Abstract

    This paper describes Luminoso's participation in SemEval 2017 Task 2, "Multilingual and Cross-lingual Semantic Word Similarity", with a system based on ConceptNet. ConceptNet is an open, multilingual knowledge graph that focuses on general knowledge that relates the meanings of words and phrases. Our submission to SemEval was an update of previous work that builds high-quality, multilingual word embeddings from a combination of ConceptNet and distributional semantics. Our system took first place in both subtasks. It ranked first in 4 out of 5 of the separate languages, and also ranked first in all 10 of the cross-lingual language pairs.

  2. Close
    Edge: Enriching Knowledge Graph Embeddings with External Text
    Saed Rezayi, Handong Zhao, Sungchul Kim et al. · 2021 · Computation and Language · AI summary available
    Abstract

    Knowledge graphs suffer from sparsity which degrades the quality of representations generated by various methods. While there is an abundance of textual information throughout the web and many existing knowledge bases, aligning information across these diverse data sources remains a challenge in the literature. Previous work has partially addressed this issue by enriching knowledge graph entities based on "hard" co-occurrence of words present in the entities of the knowledge graphs and external text, while we achieve "soft" augmentation by proposing a knowledge graph enrichment and embedding framework named Edge. Given an original knowledge graph, we first generate a rich but noisy augmented…

  3. Related
    Knowledge Infused Decoding
    Ruibo Liu, Guoqing Zheng, Shashank Gupta et al. · 2022 · Computation and Language · AI summary available
    Abstract

    Pre-trained language models (LMs) have been shown to memorize a substantial amount of knowledge from the pre-training corpora; however, they are still limited in recalling factually correct knowledge given a certain context. Hence, they tend to suffer from counterfactual or hallucinatory generation when used in knowledge-intensive natural language generation (NLG) tasks. Recent remedies to this problem focus on modifying either the pre-training or task fine-tuning objectives to incorporate knowledge, which normally require additional costly training or architecture modification of LMs for practical applications. We present Knowledge Infused Decoding (KID) -- a novel decoding algorithm for ge…

  4. Related
    Joint Embedding Learning of Educational Knowledge Graphs
    Siyu Yao, Ruijie Wang, Shen Sun et al. · 2019 · Computation and Language · AI summary available
    Abstract

    As an efficient model for knowledge organization, the knowledge graph has been widely adopted in several fields, e.g., biomedicine, sociology, and education. And there is a steady trend of learning embedding representations of knowledge graphs to facilitate knowledge graph construction and downstream tasks. In general, knowledge graph embedding techniques aim to learn vectorized representations which preserve the structural information of the graph. And conventional embedding learning models rely on structural relationships among entities and relations. However, in educational knowledge graphs, structural relationships are not the focus. Instead, rich literals of the graphs are more valuable…

  5. Related
    CORE-KG: An LLM-Driven Knowledge Graph Construction Framework for Human Smuggling Networks
    Dipak Meher, Carlotta Domeniconi, Guadalupe Correa-Cabrera · 2025 · Computation and Language · AI summary available
    Abstract

    Human smuggling networks are increasingly adaptive and difficult to analyze. Legal case documents offer valuable insights but are unstructured, lexically dense, and filled with ambiguous or shifting references-posing challenges for automated knowledge graph (KG) construction. Existing KG methods often rely on static templates and lack coreference resolution, while recent LLM-based approaches frequently produce noisy, fragmented graphs due to hallucinations, and duplicate nodes caused by a lack of guided extraction. We propose CORE-KG, a modular framework for building interpretable KGs from legal texts. It uses a two-step pipeline: (1) type-aware coreference resolution via sequential, structu…

  6. Related
    The Geometry of Culture: Analyzing Meaning through Word Embeddings
    Austin C. Kozlowski, Matt Taddy, James A. Evans · 2018 · American Sociological Review 2019, Vol. 84(5) 905-949 · AI summary available
    Abstract

    We demonstrate the utility of a new methodological tool, neural-network word embedding models, for large-scale text analysis, revealing how these models produce richer insights into cultural associations and categories than possible with prior methods. Word embeddings represent semantic relations between words as geometric relationships between vectors in a high-dimensional space, operationalizing a relational model of meaning consistent with contemporary theories of identity and culture. We show that dimensions induced by word differences (e.g. man - woman, rich - poor, black - white, liberal - conservative) in these vector spaces closely correspond to dimensions of cultural meaning, and th…

  7. Related
    Can LLMs Convert Graphs to Text-Attributed Graphs?
    Zehong Wang, Sidney Liu, Zheyuan Zhang et al. · 2024 · Computation and Language · AI summary available
    Abstract

    Graphs are ubiquitous data structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. Graph neural networks (GNNs) have become a popular tool to learn node embeddings through message passing on these structures. However, a significant challenge arises when applying GNNs to multiple graphs with different feature spaces, as existing GNN architectures are not designed for cross-graph feature alignment. To address this, recent approaches introduce text-attributed graphs, where each node is associated with a textual description, enabling the use of a shared textual encoder to project nodes from different graphs into a unified fe…

  8. Related
    GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning
    Costas Mavromatis, George Karypis · 2024 · Computation and Language · AI summary available
    Abstract

    Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the reasoning to the information provided by the KG. Large Language Models (LLMs) are the state-of-the-art models for QA tasks due to their remarkable ability to understand natural language. On the other hand, Graph Neural Networks (GNNs) have been widely used for KGQA as they can handle the complex graph information stored in the KG. In this work, we introduce GNN-RAG, a novel method for combining language understanding abilities of LLMs with the reasoning abil…

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

For now only among the papers summarized on this site: search again to add the prior work, the follow-ups and Semantic Scholar’s recommendations.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.