Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first approach
-
Updated
Jan 15, 2024 - Python
#
preference-data
Here are 8 public repositories matching this topic...
Generate conversational, tool-calling, structured-output, and preference datasets — easily and at scale
conversational persona structured-output afterimage multi-turn dpo synthetic-dataset preference-data tool-calling
-
Updated
May 13, 2026 - Python
MCP server for human-in-the-loop surveys, A/B preference tests, ratings, and rankings. Get real human feedback inside Claude Code, Claude Desktop, Cursor, Windsurf, and any MCP client — powered by Datapoint AI.
annotation mcp cursor surveys datapoint human-in-the-loop ai-agents claude windsurf data-labeling ai-evaluation human-feedback rlhf anthropic llm-evaluation preference-data claude-desktop model-context-protocol mcp-server claude-code
-
Updated
Jun 12, 2026 - Python
Curated tools, papers, datasets, and practices for LLM training data engineering.
annotation data-quality synthetic-data training-data data-governance llm rlhf financial-ai rag-evaluation preference-data
-
Updated
Jun 13, 2026 - Python
Pairwise rating CLI for AI responses — per-axis scoring (helpfulness/harmlessness/accuracy/instruction-following), JSONL in/out, inter-rater Cohen's kappa
-
Updated
Jun 4, 2026 - Python
A forkable example of the human-in-the-loop model-improvement loop: AI generates, humans judge via the Terac MCP, you improve the model. Built as an SVG illustration arena.
-
Updated
Jun 20, 2026 - TypeScript
This repository contains all artifacts produced during my bachelor's thesis on data modeling for collective decision-making.
-
Updated
Apr 15, 2026 - Jupyter Notebook
RLHF preference data curation pipeline: HH-RLHF + UltraFeedback + OASST1 → quality filter → MinHash dedup → DPO-ready JSONL
-
Updated
Jun 7, 2026 - Python
Improve this page
Add a description, image, and links to the preference-data topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the preference-data topic, visit your repo's landing page and select "manage topics."