✨ Attention Information Extraction Enthusiasts ✨ I am excited to announce the release of our latest paper and model family, ReLiK, a cutting-edge… | 33 comments on LinkedIn

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a…

𝗥𝗔𝗚 𝗜𝗺𝗽𝗹𝗲𝗺𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻𝘀 𝗙𝗮𝗶𝗹 𝗗𝘂𝗲 𝗧𝗼 𝗜𝗻𝘀𝘂𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝘁 𝗙𝗼𝗰𝘂𝘀 𝗢𝗻 𝗤𝘂𝗲𝘀𝘁𝗶𝗼𝗻 𝗜𝗻𝘁𝗲𝗻𝘁 𝘛𝘩𝘦 𝘔𝘪𝘯𝘥𝘧𝘶𝘭-𝘙𝘈𝘎… | 12 comments on LinkedIn

Additionally, there are evaluation methods where LLMs serve as the evaluators, including single point, reference-based, and pairwise-based…

This is something very cool! 3. GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models "GraphReader addresses the…

The Programmable Neuro-Symbolic AGI that lets you program its behavior using Graph-based Prompt Programming: for people who want AI to behave as expected - SynaLinks/HybridAGI

Ask your (research) question against 76 Million scientific articles: https://ask.orkg.org Open Research Knowledge Graph (ORKG) ASK (Assistant for Scientific…

Our paper "Are Large Language Models a Good Replacement of Taxonomies?" was just accepted to VLDB'2024! This finished our last stroke of study on how knowledgeable LLMs are and confirmed our recommendation for the next generation of KGs. How knowledgeable are LLMs? 1.

Can LLMs understand graphs? The results might surprise you. Graphs are everywhere, from social networks to biological pathways. As AI systems become more…

RAG + Knowledge Graphs cut customer support resolution time by 29.6%. 📉 A case study from LinkedIn. 🤝💼 Conventional RAG methods treat historical issue… | 10 comments on LinkedIn

Large language models (LLMs) have demonstrated impressive reasoning abilities in complex tasks. However, they lack up-to-date knowledge and experience hallucinations during reasoning, which can...

Knowledge Graph (KG) inductive reasoning, which aims to infer missing facts from new KGs that are not seen during training, has been widely adopted in various applications. One critical challenge...

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of...

Introducing Docs2KG: A New Era in Knowledge Graph Construction from Unstructured Data ... Did you know that 80% of enterprise data resides in unstructured… | 13 comments on LinkedIn

GNN-RAG Combines the language understanding abilities of LLMs with the reasoning abilities of GNNs in a RAG style. The GNN extracts useful and relevant…

💡 How important are learning paths for gaining the skills needed to tackle real-life problems? 🔬Researchers from the University of Siegen (Germany) and Keio…

In applications such as personal assistants, large language models (LLMs) must consider the user's personal information and preferences. However, LLMs lack the inherent ability to learn from user...

To Graph or Not to Graph Knowledge Graph Architectures and LLMs - Download as a PDF or view online for free

Revolutionizing Document Reranking with G-RAG: A Graph-Based Approach ... Discover how a novel graph-based reranker is transforming the way we retrieve…

Reduce LLM hallucinations with RAG over textual as well as structured knowledge bases. Today we are releasing WSTaRK h, a large-scale LLM retrieval benchmark… | 22 comments on LinkedIn

How can we further increase the accuracy of LLM-powered question answering systems? Ontologies to the rescue! That is the conclusion of the latest research… | 16 comments on LinkedIn

An open-source library for building knowledge graphs from text corpus using open-source LLMs like Llama 3 and Mixtral.

Language models have achieved impressive performances on dialogue generation tasks. However, when generating responses for a conversation that requires factual knowledge, they are far from perfect, due to an absence of mechanisms to retrieve, encode, and reflect the knowledge in the generated responses. Some knowledge-grounded dialogue generation methods tackle this problem by leveraging facts from Knowledge Graphs (KGs); however, they do not guarantee that the model utilizes a relevant piece of knowledge from the KG. To overcome this limitation, we propose SUbgraph Retrieval-augmented GEneration (SURGE), a framework for generating context-relevant and knowledge-grounded dialogues with the KG. Specifically, our SURGE framework first retrieves the relevant subgraph from the KG, and then enforces consistency across facts by perturbing their word embeddings conditioned by the retrieved subgraph. Then, we utilize contrastive learning to ensure that the generated texts have high similarity to the retrieved subgraphs. We validate our SURGE framework on OpendialKG and KOMODIS datasets, showing that it generates high-quality dialogues that faithfully reflect the knowledge from KG.

Recent work demonstrated great promise in the idea of orchestrating collaborations between LLMs, human input, and various tools to address the inherent limitations of LLMs. We propose a novel perspective called semantic decoding, which frames these collaborative processes as optimization procedures in semantic space. Specifically, we conceptualize LLMs as semantic processors that manipulate meaningful pieces of information that we call semantic tokens (known thoughts). LLMs are among a large pool of other semantic processors, including humans and tools, such as search engines or code executors. Collectively, semantic processors engage in dynamic exchanges of semantic tokens to progressively construct high-utility outputs. We refer to these orchestrated interactions among semantic processors, optimizing and searching in semantic space, as semantic decoding algorithms. This concept draws a direct parallel to the well-studied problem of syntactic decoding, which involves crafting algorithms to best exploit auto-regressive language models for extracting high-utility sequences of syntactic tokens. By focusing on the semantic level and disregarding syntactic details, we gain a fresh perspective on the engineering of AI systems, enabling us to imagine systems with much greater complexity and capabilities. In this position paper, we formalize the transition from syntactic to semantic tokens as well as the analogy between syntactic and semantic decoding. Subsequently, we explore the possibilities of optimizing within the space of semantic tokens via semantic decoding algorithms. We conclude with a list of research opportunities and questions arising from this fresh perspective. The semantic decoding perspective offers a powerful abstraction for search and optimization directly in the space of meaningful concepts, with semantic tokens as the fundamental units of a new type of computation.

Neurosymbolic AI is an increasingly active area of research that combines symbolic reasoning methods with deep learning to leverage their complementary benefits. As knowledge graphs are becoming a popular way to represent heterogeneous and multi-relational data, methods for reasoning on graph structures have attempted to follow this neurosymbolic paradigm. Traditionally, such approaches have utilized either rule-based inference or generated representative numerical embeddings from which patterns could be extracted. However, several recent studies have attempted to bridge this dichotomy to generate models that facilitate interpretability, maintain competitive performance, and integrate expert knowledge. Therefore, we survey methods that perform neurosymbolic reasoning tasks on knowledge graphs and propose a novel taxonomy by which we can classify them. Specifically, we propose three major categories: (1) logically-informed embedding approaches, (2) embedding approaches with logical constraints, and (3) rule learning approaches. Alongside the taxonomy, we provide a tabular overview of the approaches and links to their source code, if available, for more direct comparison. Finally, we discuss the unique characteristics and limitations of these methods, then propose several prospective directions toward which this field of research could evolve.

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable them to perform multi-step inferences over real-world knowledge graphs while minimizing hallucination. While large language models excel at conversation and text generation, their ability to reason over domain-specialized graphs of interconnected entities remains limited. For example, can we query a LLM to identify the optimal contact in a professional network for a specific goal, based on relationships and attributes in a private database? The answer is no--such capabilities lie beyond current methods. However, this question underscores a critical technical gap that must be addressed. Many high-value applications in areas such as science, security, and e-commerce rely on proprietary knowledge graphs encoding unique structures, relationships, and logical constraints. We introduce a fine-tuning framework for developing Graph-aligned LAnguage Models (GLaM) that transforms a knowledge graph into an alternate text representation with labeled question-answer pairs. We demonstrate that grounding the models in specific graph-based knowledge expands the models' capacity for structure-based reasoning. Our methodology leverages the large-language model's generative capabilities to create the dataset and proposes an efficient alternate to retrieval-augmented generation styled methods.

Exploring the Potential of AI-Powered Knowledge Graphs with MindGraph ... Have you ever wondered how we can harness the power of AI to create and explore…

Knowledge Discovery and Generation: Synergizing Knowledge Graphs and Large Language Models 💡 In today’s era of information explosion, the volume of… | 14 comments on LinkedIn

Unlocking the Secrets of Scientific Discovery with AI and Knowledge Graphs ... Have you ever wondered how AI could revolutionize the way we conduct scientific… | 17 comments on LinkedIn

Graph Neural Prompting with Large Language Models