GitHub / explodinggradients/ragas / commits
| SHA | Message | Author | Date | Stats |
|---|---|---|---|---|
| 2b387249 | chore: remove office hours cal (#2583) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
7 months ago | |
| f5f62387 |
fix: fix testset generation bugs (#2568)
Co-authored-by: Nikita Kravchuk <k****9@g****m> |
Nikita Kravchuk <4****n@u****m>
Committed by: GitHub <n****y@g****m> |
7 months ago | |
| db8eb679 | perf: optimize average precision algorithm (#2567) |
XlKsyt <c****n@o****m>
Committed by: GitHub <n****y@g****m> |
7 months ago | |
| b928239d | feat: add mode parameter to llm_factory for custom instructor modes (#2565) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| e0ee3a11 | docs: fix readme's quickstart and quickstart link (#2563) |
Injae Ryou <i****u@g****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 3884c7e3 | fix: detect and handle OpenAI-compatible API style for generic providers (dee... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 592670b4 | docs: fix Install docs dependencies (#2564) |
Injae Ryou <i****u@g****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 4ecab384 | fix: add repository parameter to checkout action for fork PR support (#2559) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 7bef7824 | docs: fix DiscreteMetric llm examples to match API (#2558) |
ASWIN C G <7****n@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 917a055a | fix: comment on failed task (#2557) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 38648500 | fix: lazy init DEFAULT_TOKENIZER to avoid network calls at import time. (#2545) |
ASWIN C G <7****n@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 979048d4 | fix: resolve `DiskCacheBackend` pickling issue with `InstructorLLM` (#2556) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 77acfe3d | fix: enable FactualCorrectness language adaptation (#2555) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| d55c22da | feat: add remaining quickstart templates (#2547) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 7b4eae83 | fix: use PAT token for docs-check CI as docs-apply CI (#2546) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 36654940 | feat(docs): add copy-to-llm button for easy AI tool integration (#2541) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| cb998ba3 | feat: add system prompt support for `InstructorLLM` and `LiteLLMStructuredLLM... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 56e316c9 | feat: dspy caching (#2542) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 8334eb20 | feat(docs): add llms.txt generation for LLM-friendly documentation (#2539) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 94b66302 | feat: add `DSPyOptimizer` with `MIPROv2` for advanced prompt optimization (#2... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| bf611788 | feat: add caching support for embeddings (#2536) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| c5b197f0 | feat: add caching support for metrics collections (#2533) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 17896530 | chore: remove survey link (#2535) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| fc8041cf | fix: increase max-turns and update prompt (#2534) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| c5369fab | docs: change query execution to use asyncio.run (#2532) |
Zhiqiang Yang <y****0@g****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| e18d3be5 | fix: claude workflows to use pat token instead of github token to support for... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| f6e8c769 | feat(docs): add offline mermaid support to PDF export (#2530) |
ASWIN C G <7****n@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 23f116f9 | feat: add `generate_with_chunks` for pre-chunked documents (#2526) |
MinseongS <7****S@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 6098660b | feat: add HuggingFace tokenizer support in knowledge graph operations (#2524) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 2dd64aa9 | fix: claude workflows to use github token (#2527) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
8 months ago | |
| 1d97cc09 | refactor: deprecate legacy metrics (#2519) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| c143d0be | Feat: document PDF export workflow (#2522) |
ASWIN C G <7****n@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| c81cbcfb |
[AG-UI] Replacing "OpenAI" with "AsyncOpenAI". (#2520)
Co-authored-by: Mark Fogle <m****k@f****m> |
Mark <m****k@c****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| cd593e25 | fix: use instructor Mode.JSON for litellm and generic providers to fix Dict t... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 0cf07362 | feat: add support for new google-genai SDK with backwards compatibility for d... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 6d0d189b | feat: migrate MultiModalRelevance to collections API (#2518) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| bdbaebfb | feat: migrate MultiModalFaithfulness to collections API (#2515) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 85bf0719 | fix: allow unannotated parameters to accept any type (#2513) |
Dhyaneesh DS <9****h@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 41b67abf | feat: add Claude docs auto-update workflow (#2508) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| f06e0284 | fix: handle nested dicts/lists in ToolCallF1 args to prevent unhashable type ... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 84c038d9 | docs: fix modifying-prompts-metrics guide with correct API (#2486) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 46f14ac7 |
Add AG-UI Protocol Integration for Agent Evaluation (#2395)
Co-authored-by: Claude <n****y@a****m>, Ani <5****k@u****m> |
Mark <m****k@c****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 4459c394 | fix: BasePrompt.adapt() structured output + language adaptation guide (#2487) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 871d723b | docs: remove obsolete 'write your own metric' guides (#2488) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 9d2d3f27 | fix: handle instructor modes for json and tools (#2505) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 91c97121 | feat: migrate quoted spans metric to collections api (#2504) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| a87c51f7 | fix: handle classification array length mismatch in TopicAdherence metric (#2... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 60cc097d | Feat/improve rag quickstart (#2501) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 51b989df | fix: migrate CHRF Score to new metrics collections (#2500) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 22377f8d | feat: migrate DataCompyScore to collections API (#2499) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| c4e5f319 | feat: migrate SQLSemanticEquivalence to collections API (#2496) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 4308b246 | feat: migrate Rubrics Metrics to collections API (#2494) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 9e5a791c | docs: remove broken reference to train_your_own_metric.md (#2489) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| d6e54743 | aembed_text() replace embed_text() in AnswerRelevancy (#2495) |
blueoom <4****e@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| f19972bc | docs: organize integrations nav into collapsible groups (#2492) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 15d09ada | feat: migrate TopicAdherence and AgentGoalAccuracy to collections API (#2485) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| d8a777af | New input parameter for the TestsetGenerator Class : LLM_CONTEXT (#2474) |
narabi <5****i@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 63d5f543 | feat: migrate ToolCallF1 to collections API with set-based F1 scoring (#2483) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 88f8cb5e | Fix: apply_transforms(kg, transforms, run_config=run_config or RunConfig (#2480) |
narabi <5****i@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| c3524597 | chore: add survey link to readme and docs banner (#2478) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 0b1ac130 | feat: migrate `ToolCallAccuracy` to collections API (#2476) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 3e28e9de | fix: add anthropic and gemini clients for custom clients (#2472) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| b38b3fee | docs: update run_config guide to use collections API (#2468) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| e62ff194 | feat: add save/load methods to BasePrompt (#2465) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 877ed6cb | docs: add migration guide for v0.4 (#2461) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 9247fce3 | fix: make GoogleEmbeddings handle GenerativeModel clients by auto-extracting ... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 1bd6bdde | chore: update calendar email (#2462) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| c80064a8 | fix: quickstart (#2463) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| d2e2315a | fix: detect async clients in closures for instructor-wrapped litellm routers ... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 9e831f7f | docs: Update customizations how-to guides to use collections API and LLM fact... |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| b4baf613 | fix: make GitPython an optional dependency (#2453) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| dd5bce77 | fix: automatic embedding provider matching for LLMs (#2454) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 32b4afc8 | fix: correct MultiTurnSample user_input validation logic (#2426) |
Harshil Sanghvi <6****i@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| bd46e301 | fix: retrieved_contexts string filtering in LangChain integration (#2452) |
Dhyaneesh DS <9****h@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| d38fe9be | fix: resolve InstructorLLM detection bug and add EvaluationDataset backend su... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 30195c0e | feat: dual adapter support (Instructor + LiteLLM) (#2446) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 50b4a45c | chore: rebranding efforts (#2445) |
Jithin James <j****n@e****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 583cb7e7 | chore: cleanup old patterns and update links (#2449) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| ad892a6b | docs: clarify MLflow is required, not optional in RAG evaluation guide (#2447) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 9a65f552 | chore: add COC (#2437) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 691ad9f9 | feat: migrate final metrics (FactualCorrectness, NoiseSensitivity) to modular... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| facaab81 | feat: migrate 6 metrics (ContextRelevance, Response Groundedness, AnswerAccur... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| dd680cf2 | feat: migrate context recall, answer relevancy, and context entity recall met... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| ed7a132d | Fix 2440 Adjust LLM parameters in evals.py (#2441) |
Rares Vernica <r****a@g****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| f0eff321 | Fix 2432: Update import statements for langchain modules (#2436) |
Rares Vernica <r****a@g****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 211ccf9f | fix: docs for quickstart (#2434) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| f212a35c |
feat: implement prompt class for context precision (#2433)
Co-authored-by: Rahul Bhatnagar <r****x@g****m> |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
9 months ago | |
| 936001bc |
docs: fix typos in some files (#2429)
Co-authored-by: khanhkhanhlele <n****x@g****m> |
Edge-Seven <1****n@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| 1ffc6d54 | feat: migrate to instructor.from_provider for universal provider support (#2424) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| 41cc83b9 | update: add llm options as tabs to quickstart (#2421) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| 7303df13 | feat: support GPT-5 and o-series models with automatic `temperature` and `top... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| d4aa665e | docs: complete collections API documentation for remaining metrics (#2420) |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| 8b4653c4 | chore: update quickstart llm config (#2417) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| 1442e6f4 |
feat: migrate context recall (#2372)
Co-authored-by: Kumar Anirudha <m****l@a****v> |
Jithin James <j****n@e****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| e86105b8 | refactor: make embeddings optional in AnswerCorrectness when using pure factu... |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| cffb1e96 | fix: handle `max_completeion_tokens` error for newer openai models (#2413) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| 4cb829df | chore: remove deprecated functions (#2412) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| b99907c1 | fix: office hours link update (#2415) |
Ani <5****k@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| aa7b7bbe |
Response Groundedness (#2403)
Co-authored-by: Ani <5****k@u****m> |
rhlbhatnagar <6****r@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago | |
| 023e332a | docs: Update documentation structure to reflect experiments-first paradigm (#... |
Sanjeed <4****5@u****m>
Committed by: GitHub <n****y@g****m> |
10 months ago |