Ollama Grid Search is a desktop application designed to automate the evaluation and comparison of large language models, prompts, and inference parameters in a structured and repeatable way. Instead of manually testing combinations, the tool performs grid search experiments by iterating across different models, prompt variations, and parameter configurations, allowing users to quickly identify optimal setups for specific tasks. It provides a visual interface where experiment results can be inspected, compared, and refined, making it especially useful for prompt engineering and benchmarking workflows. The system integrates directly with local or remote Ollama servers, enabling seamless access to models already deployed in a user’s environment. It also includes experiment logging and A/B testing capabilities, which allow users to compare outputs side by side and track performance metrics such as latency or token usage.

Features

  • Automated grid search across models and parameters
  • A/B testing of prompts and model outputs
  • Visual comparison of experiment results
  • Integration with local and remote Ollama servers
  • Experiment logging and reproducibility tracking
  • Metadata capture including tokens and inference time

Project Samples

Project Activity

See All Activity >