[PR #3923] Add AI Evaluation #56043

Open
opened 2026-06-18 07:16:37 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/sindresorhus/awesome/pull/3923
Author: @Vvkmnn
Created: 2/4/2026
Status: 🔄 Open

Base: mainHead: add-eval


📝 Commits (1)

📊 Changes

1 file changed (+1 additions, -0 deletions)

View changed files

📝 readme.md (+1 -0)

📄 Description

https://github.com/Vvkmnn/awesome-ai-eval#readme

Measuring reliability, accuracy, and safety of LLMs, RAG pipelines, and AI agents in production environments.

PRs reviewed:

By submitting this pull request I confirm I've read and complied with the below requirements 🖖

Requirements for your pull request

  • Don't open a Draft / WIP pull request while you work on the guidelines. A pull request should be 100% ready and should adhere to all the guidelines when you open it.
  • Don't waste my time. Do a good job, adhere to all the guidelines, and be responsive.
  • You have to review at least 2 other open pull requests.
  • You have read and understood the instructions for creating a list.
  • This pull request has a title in the format Add Name of List. It should not contain the word Awesome.
  • Your entry here should include a short description of the project/theme of the list. It should not describe the list itself.
  • Your entry should be added at the bottom of the appropriate category.
  • The title of your entry should be title-cased and the URL to your list should end in #readme.
  • No blockchain-related lists.
  • The suggested Awesome list complies with the below requirements.

Requirements for your Awesome list

  • Has been around for at least 30 days. (Created November 18, 2025 — 78+ days ago)
  • Run awesome-lint on your list and fix the reported issues. ✔ Linting passed.
  • The default branch should be named main, not master.
  • Includes a succinct description of the project/theme at the top of the readme.
  • It's the result of hard work and the best I could possibly produce.
  • The repo name of your list should be in lowercase slug format: awesome-ai-eval.
  • The heading title of your list should be in title case format: # Awesome AI Eval.
  • Non-generated Markdown file in a GitHub repo.
  • The repo should have awesome-list & awesome as GitHub topics.
  • Not a duplicate. Please search for existing submissions.
  • Only has awesome items. Awesome lists are curations of the best, not everything.
  • Does not contain items that are unmaintained, has archived repo, deprecated, or missing docs.
  • Includes a project logo/illustration.
  • Entries have a description.
  • Includes the Awesome badge.
  • Has a Table of Contents section named Contents.
  • Has an appropriate license. (CC0)
  • Has contribution guidelines.
  • Has consistent formatting and proper spelling/grammar.
  • Does not use hard-wrapping.
  • Does not include a CI badge.
  • Does not include an "Inspired by awesome-foo" or "Inspired by the Awesome project" kind of link at the top of the readme.

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/sindresorhus/awesome/pull/3923 **Author:** [@Vvkmnn](https://github.com/Vvkmnn) **Created:** 2/4/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `add-eval` --- ### 📝 Commits (1) - [`d138ea6`](https://github.com/sindresorhus/awesome/commit/d138ea6275ba4f5ec287b56a203049e9a80aca25) Add AI Evaluation ### 📊 Changes **1 file changed** (+1 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `readme.md` (+1 -0) </details> ### 📄 Description **https://github.com/Vvkmnn/awesome-ai-eval#readme** Measuring reliability, accuracy, and safety of LLMs, RAG pipelines, and AI agents in production environments. **PRs reviewed:** - https://github.com/sindresorhus/awesome/pull/3831#issuecomment-3845201459 - https://github.com/sindresorhus/awesome/pull/3919#issuecomment-3845227523 ### By submitting this pull request I confirm I've read and complied with the below requirements 🖖 ## Requirements for your pull request - [x] Don't open a Draft / WIP pull request while you work on the guidelines. A pull request should be 100% ready and should adhere to all the guidelines when you open it. - [x] **Don't waste my time.** Do a good job, adhere to all the guidelines, and be responsive. - [x] **You have to review at least 2 other [open pull requests](https://github.com/sindresorhus/awesome/pulls?q=is%3Apr+is%3Aopen).** - [x] You have read and understood the [instructions for creating a list](https://github.com/sindresorhus/awesome/blob/main/create-list.md). - [x] This pull request has a title in the format `Add Name of List`. It should not contain the word `Awesome`. - [x] Your entry here should include a short description of the project/theme of the list. **It should not describe the list itself.** - [x] Your entry should be added at the bottom of the appropriate category. - [x] The title of your entry should be title-cased and the URL to your list should end in `#readme`. - [x] No blockchain-related lists. - [x] The suggested Awesome list complies with the below requirements. ## Requirements for your Awesome list - [x] **Has been around for at least 30 days.** (Created November 18, 2025 — 78+ days ago) - [x] Run [`awesome-lint`](https://github.com/sindresorhus/awesome-lint) on your list and fix the reported issues. ✔ Linting passed. - [x] The default branch should be named `main`, not `master`. - [x] **Includes a succinct description of the project/theme at the top of the readme.** - [x] It's the result of hard work and the best I could possibly produce. - [x] The repo name of your list should be in lowercase slug format: `awesome-ai-eval`. - [x] The heading title of your list should be in title case format: `# Awesome AI Eval`. - [x] Non-generated Markdown file in a GitHub repo. - [x] The repo should have `awesome-list` & `awesome` as GitHub topics. - [x] Not a duplicate. Please search for existing submissions. - [x] Only has awesome items. Awesome lists are curations of the best, not everything. - [x] Does not contain items that are unmaintained, has archived repo, deprecated, or missing docs. - [x] Includes a project logo/illustration. - [x] Entries have a description. - [x] Includes the [Awesome badge](https://github.com/sindresorhus/awesome/blob/main/awesome.md#awesome-badge). - [x] Has a Table of Contents section named `Contents`. - [x] Has an appropriate license. (CC0) - [x] Has [contribution guidelines](https://github.com/sindresorhus/awesome/blob/main/awesome.md#include-contribution-guidelines). - [x] Has consistent formatting and proper spelling/grammar. - [x] Does not use hard-wrapping. - [x] Does not include a CI badge. - [x] Does not include an "Inspired by awesome-foo" or "Inspired by the Awesome project" kind of link at the top of the readme. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-06-18 07:16:37 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/awesome-sindresorhus#56043