UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

👽 Out-of-Distribution Detection with PyTorch

Model Agnostic Confidence Estimator (MACEST) - A Python library for calibrating Machine Learning models' confidence scores

A list of papers that studies out-of-distribution (OOD) detection and misclassification detection (MisD)

📈 SiRE (Simulation-Informed Revenue Extrapolation with Confidence Estimate for Scaleup Companies Using Scarce Time-Series Data), accepted by CIKM'2022 🗽

PyTorch implementation of our ECCV 2022 paper "Rethinking Confidence Calibration for Failure Prediction"

Confidence scores for Neural Networks, made easy!

Learning from scratch a confidence measure

Official pytorch implementation of the paper [Adaptive confidence thresholding for monocular depth estimation]

Demo code for GACE: Geometry Aware Confidence Enhancement

Confidence Estimation for Black Box Automatic Speech Recognition Systems Using Lattice Recurrent Neural Networks https://arxiv.org/abs/1910.11933 or https://ieeexplore.ieee.org/document/9053264

CaOPD: Calibration-Aware On-Policy Distillation

Free WordPress Plugin: Calculate the exact sample size and margin of error for your next survey or study. Use our free Sample Size Calculator for statistically accurate results. www.calculator.io/sample-size-calculator/

[ACL 2025] Revisiting Epistemic Markers in Confidence Estimation: Can Markers Accurately Reflect Large Language Models' Uncertainty?.

This repo contains code to perform Bootstrap Confidence Intervals estimation (a.k.a. Monte Carlo Confidence Interval or Empirical Confidence Interval estimation) for Machine Learing models.

Score the trustworthiness of outputs from any LLM in real-time

Package for practical identifiability/predictability analysis in Python

Benchmark for "Offline Policy Comparison with Confidence"

Python framework for high quality confidence estimation of deep neural networks, providing methods such as confidence calibration and ordinal ranking

Project of ACL 2025 MlingConf: A Comprehensive Investigation of Multilingual Confidence Estimation for Large Language Models