Audience
Academic researchers and developers searching for a tool to implement efficient and scalable passage re-ranking and expansion techniques
About TILDE
TILDE (Term Independent Likelihood moDEl) is a passage re-ranking and expansion framework built on BERT, designed to enhance retrieval performance by combining sparse term matching with deep contextual representations. The original TILDE model pre-computes term weights across the entire BERT vocabulary, which can lead to large index sizes. To address this, TILDEv2 introduces a more efficient approach by computing term weights only for terms present in expanded passages, resulting in indexes that are 99% smaller than those of the original TILDE. This efficiency is achieved by leveraging TILDE as a passage expansion model, where passages are expanded using top-k terms (e.g., top 200) to enrich their content. It provides scripts for indexing collections, re-ranking BM25 results, and training models using datasets like MS MARCO.
Other Popular Alternatives & Related Software
RankLLM
RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking. It offers a suite of rerankers, pointwise models like MonoT5, pairwise models like DuoT5, and listwise models compatible with vLLM, SGLang, or TensorRT-LLM. Additionally, it supports RankGPT and RankGemini variants, which are proprietary listwise rerankers. It includes modules for retrieval, reranking, evaluation, and response analysis, facilitating end-to-end workflows. RankLLM integrates with Pyserini for retrieval and provides integrated evaluation for multi-stage pipelines. It also includes a module for detailed analysis of input prompts and LLM responses, addressing reliability concerns with LLM APIs and non-deterministic behavior in Mixture-of-Experts (MoE) models. The toolkit supports various backends, including SGLang and TensorRT-LLM, and is compatible with a wide range of LLMs.
Learn more
Vectara
Vectara is LLM-powered search-as-a-service. The platform provides a complete ML search pipeline from extraction and indexing to retrieval, re-ranking and calibration. Every element of the platform is API-addressable. Developers can embed the most advanced NLP models for app and site search in minutes.
Vectara automatically extracts text from PDF and Office to JSON, HTML, XML, CommonMark, and many more. Encode at scale with cutting edge zero-shot models using deep neural networks optimized for language understanding. Segment data into any number of indexes storing vector encodings optimized for low latency and high recall. Recall candidate results from millions of documents using cutting-edge, zero-shot neural network models. Increase the precision of retrieved results with cross-attentional neural networks to merge and reorder results. Zero in on the true likelihoods that the retrieved response represents a probable answer to the query.
Learn more
ColBERT
ColBERT is a fast and accurate retrieval model, enabling scalable BERT-based search over large text collections in tens of milliseconds. It relies on fine-grained contextual late interaction: it encodes each passage into a matrix of token-level embeddings. At search time, it embeds every query into another matrix and efficiently finds passages that contextually match the query using scalable vector-similarity (MaxSim) operators. These rich interactions allow ColBERT to surpass the quality of single-vector representation models while scaling efficiently to large corpora. The toolkit includes components for retrieval, reranking, evaluation, and response analysis, facilitating end-to-end workflows. ColBERT integrates with Pyserini for retrieval and provides integrated evaluation for multi-stage pipelines. It also includes a module for detailed analysis of input prompts and LLM responses, addressing reliability concerns with LLM APIs and non-deterministic behavior in Mixture-of-Experts.
Learn more
Jina Reranker
Jina Reranker v2 is a state-of-the-art reranker designed for Agentic Retrieval-Augmented Generation (RAG) systems. It enhances search relevance and RAG accuracy by reordering search results based on deeper semantic understanding. It supports over 100 languages, enabling multilingual retrieval regardless of the query language. It is optimized for function-calling and code search, making it ideal for applications requiring precise function signatures and code snippet retrieval. Jina Reranker v2 also excels in ranking structured data, such as tables, by understanding the downstream intent to query structured databases like MySQL or MongoDB. With a 6x speedup over its predecessor, it offers ultra-fast inference, processing documents in milliseconds. The model is available via Jina's Reranker API and can be integrated into existing applications using platforms like Langchain and LlamaIndex.
Learn more
Integrations
Company Information
ielab
United States
github.com/ielab/TILDE/tree/main
Videos and Screen Captures
Other Useful Business Software
Hybrid Bare Metal Cloud Infrastructure | Servers.com
Three bare metal hosting solutions on one global network. Spin up on demand to cover peaks, then optimize for cost when usage stabilizes.
Product Details
Platforms Supported
Cloud
Training
Documentation
Support
Online
