🤘 awesome-semantic-segmentation
-
Updated
May 8, 2021
#
evaluation
Here are 1,333 public repositories matching this topic...
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
open-source playground monitoring analytics evaluation self-hosted ycombinator openai gpt hacktoberfest observability large-language-models llm prompt-engineering langchain llmops llama-index prompt-management llm-evaluation llm-observability
-
Updated
Feb 20, 2025 - TypeScript
Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
testing ci evaluation ci-cd pentesting cicd vulnerability-scanners prompts evaluation-framework red-teaming rag llm prompt-engineering llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework
-
Updated
Feb 20, 2025 - TypeScript
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
-
Updated
Feb 20, 2025 - Python
Python package for the evaluation of odometry and SLAM
benchmark robotics tum mapping metrics evaluation ros slam trajectory-analysis odometry trajectory ros2 kitti euroc trajectory-evaluation
-
Updated
Feb 18, 2025 - Python
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
python open-source qa benchmarking ops pipeline analysis optimization evaluation embeddings automl document-parser rag llm retrieval-augmented-generation llm-ops llm-evaluation rag-evaluation
-
Updated
Feb 16, 2025 - Python
Building a modern functional compiler from first principles. (http://dev.stephendiehl.com/fun/)
compiler functional-programming book lambda-calculus evaluation type-theory type pdf-book type-checking haskel type-system functional-language hindley-milner type-inference intermediate-representation
-
Updated
Jan 11, 2021 - Haskell
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
open-source playground monitoring analytics evaluation ycombinator openai gpt large-language-models llm prompt-engineering langchain llmops llama-index prompt-management llm-evaluation llm-observability agent-monitoring llm-cost
-
Updated
Feb 20, 2025 - TypeScript
Klipse is a JavaScript plugin for embedding interactive code snippets in tech blogs.
react javascript ruby python scheme clojure lua clojurescript reactjs common-lisp ocaml brainfuck evaluation prolog codemirror-editor reasonml interactive-snippets code-evaluation klipse-plugin
-
Updated
Oct 1, 2024 - HTML
SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese
-
Updated
May 23, 2024
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
audio deep-learning tensorflow paper end-to-end evaluation cnn lstm speech-recognition rnn automatic-speech-recognition feature-vector data-preprocessing phonemes timit-dataset layer-normalization rnn-encoder-decoder chinese-speech-recognition
-
Updated
Mar 24, 2023 - Python
A unified evaluation framework for large language models
benchmark evaluation prompt robustness adversarial-attacks large-language-models prompt-engineering chatgpt
-
Updated
Feb 11, 2025 - Python
An open-source visual programming environment for battle-testing prompts to LLMs.
-
Updated
Feb 19, 2025 - TypeScript
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
machine-learning monitoring evaluation experimentation jailbreak-detection autoevaluation root-cause-analysis prompt-engineering llmops openai-evals llm-prompting llm-eval llm-test hallucination-detection
-
Updated
Aug 18, 2024 - Python
Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
-
Updated
Feb 20, 2025 - Python
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
-
Updated
Jan 10, 2025 - Python
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
computer-vision evaluation pytorch gemini openai vqa vit gpt multi-modal clip claude openai-api gpt4 large-language-models llm chatgpt llava qwen gpt-4v
-
Updated
Feb 20, 2025 - Python
Avalanche: an End-to-End Library for Continual Learning based on PyTorch.
training library framework deep-learning metrics evaluation pytorch benchmarks strategies lifelong-learning continual-learning continualai
-
Updated
Oct 29, 2024 - Python
Improve this page
Add a description, image, and links to the evaluation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the evaluation topic, visit your repo's landing page and select "manage topics."