{"id":346,"date":"2025-10-16T20:00:00","date_gmt":"2025-10-16T20:00:00","guid":{"rendered":"https:\/\/ppc.mit.edu\/a2\/?p=346"},"modified":"2025-10-16T19:59:33","modified_gmt":"2025-10-16T19:59:33","slug":"finally-a2rchi-v1-2-0-released","status":"publish","type":"post","link":"https:\/\/ppc.mit.edu\/a2\/2025\/10\/finally-a2rchi-v1-2-0-released\/","title":{"rendered":"Finally, A2RCHI v1.2.0 Released"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">After an intense summer full of new ideas, refactoring and new people joining, t<strong>he A2RCHI v1.2.0 Release is out and among others includes Multi-Configuration Support, Hybrid Search, and a Benchmarking Framework<\/strong>. It is bringing over 200 commits of architectural improvements, new retrieval methods, and tooling for systematic evaluation. Get A2RCHI v1.2.0 from the <a href=\"https:\/\/github.com\/mit-submit\/A2rchi\"><u>GitHub repository<\/u><\/a>.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"737\" src=\"https:\/\/ppc.mit.edu\/a2\/wp-content\/uploads\/2025\/10\/Commits-1024x737.png\" alt=\"\" class=\"wp-image-348\" style=\"width:723px;height:auto\" srcset=\"https:\/\/ppc.mit.edu\/a2\/wp-content\/uploads\/2025\/10\/Commits-1024x737.png 1024w, https:\/\/ppc.mit.edu\/a2\/wp-content\/uploads\/2025\/10\/Commits-300x216.png 300w, https:\/\/ppc.mit.edu\/a2\/wp-content\/uploads\/2025\/10\/Commits-768x553.png 768w, https:\/\/ppc.mit.edu\/a2\/wp-content\/uploads\/2025\/10\/Commits.png 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h4 class=\"wp-block-heading\">Key Updates<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">The <strong>Benchmarking Framework<\/strong> provides comprehensive tooling for evaluating A2RCHI configurations:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Two main modes for evaluation: checking for correct source retrieval and Ragas implementation for various metrics to grade answers<\/li>\n\n\n\n<li>Support for multiple evaluation LLMs and providers<\/li>\n\n\n\n<li>Configurable timeout, embedding model, verbosity, and batch size<\/li>\n\n\n\n<li>Query configuration via queries.json<\/li>\n\n\n\n<li>Visualization and plotting tools<\/li>\n\n\n\n<li>Dedicated benchmarking documentation<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">This framework enables systematic comparison of different retrieval strategies, prompt configurations, and model choices with quantifiable metrics. <strong>New LLM Integrations<\/strong> include full Ollama support for local model inference with configurable GPU allocation, enhanced vLLM integration, and improved HuggingFace compatibility. <strong>Hybrid Search with BM25<\/strong> combines semantic search with keyword matching for improved retrieval accuracy. Optional document stemming is now configurable for both documents and queries, particularly useful for technical documentation. <strong>Multi-Configuration Support<\/strong> allows running multiple prompt configurations simultaneously with on-the-fly switching through a UI dropdown. Different configurations can now be tested and deployed for specific use cases without redeployment.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Additional Features<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Git Repository Scraper<\/strong> ingests documentation directly from repositories with automatic MkDocs detection<\/li>\n\n\n\n<li><strong>Optimized Docker Images<\/strong> with GPU and non-GPU variants available on DockerHub for faster deployments<\/li>\n\n\n\n<li><strong>ChromaDB REST API<\/strong> provides programmatic access to the vector store with document listing and search endpoints<\/li>\n\n\n\n<li><strong>GitHub Actions CI\/CD<\/strong> with automated testing and PR preview environments<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Documentation &amp; Resources<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/github.com\/mit-submit\/A2rchi\/releases\/tag\/v1.2.0\"><u><strong>Full Release Notes<\/strong><\/u><\/a> &#8211; Complete changelog<\/li>\n\n\n\n<li><a href=\"https:\/\/mit-submit.github.io\/A2rchi\/\"><u><strong>Documentation<\/strong><\/u><\/a> &#8211; User and developer guides<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/mit-submit\/A2rchi\"><u><strong>GitHub Repository<\/strong><\/u><\/a> &#8211; Source code and issues<\/li>\n\n\n\n<li><a href=\"https:\/\/mit-submit.github.io\/A2rchi\/user_guide\/\"><u><strong>Benchmarking Guide<\/strong><\/u><\/a> &#8211; Evaluation documentation<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Breaking Changes<\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">Configuration structure has been refactored. The chain section is now pipelines, and several configuration keys have been reorganized. Existing configuration files will need migration. See the <a href=\"https:\/\/github.com\/mit-submit\/A2rchi\/releases\/tag\/v1.2.0\"><u>full release notes<\/u><\/a> for details.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>After an intense summer full of new ideas, refactoring and new people joining, the A2RCHI v1.2.0 Release is out and among others includes Multi-Configuration Support, Hybrid Search, and a Benchmarking Framework. It is bringing over 200 commits of architectural improvements, new retrieval methods, and tooling for systematic evaluation. Get A2RCHI v1.2.0 from the GitHub repository. [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":348,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-346","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/posts\/346","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/comments?post=346"}],"version-history":[{"count":5,"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/posts\/346\/revisions"}],"predecessor-version":[{"id":354,"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/posts\/346\/revisions\/354"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/media\/348"}],"wp:attachment":[{"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/media?parent=346"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/categories?post=346"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ppc.mit.edu\/a2\/wp-json\/wp\/v2\/tags?post=346"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}