<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Aws on Viswa Balaji</title><link>https://viswabalaji.github.io/tags/aws/</link><description>Recent content in Aws on Viswa Balaji</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><lastBuildDate>Tue, 02 Sep 2025 00:00:00 +0000</lastBuildDate><atom:link href="https://viswabalaji.github.io/tags/aws/index.xml" rel="self" type="application/rss+xml"/><item><title>Reflections on Amazon Bedrock Inference Team</title><link>https://viswabalaji.github.io/technical/reflections-amazon-bedrock-inference-team/</link><pubDate>Tue, 02 Sep 2025 00:00:00 +0000</pubDate><guid>https://viswabalaji.github.io/technical/reflections-amazon-bedrock-inference-team/</guid><description>&lt;p&gt;In September 2023, I moved to a new team that was being setup. I didn&amp;rsquo;t know who my manager was going to be or the exact nature of this project. Later I&amp;rsquo;d find out that we&amp;rsquo;d be integrating Anthropic&amp;rsquo;s Claude models into AWS infrastructure as part of the new &lt;a href="https://press.aboutamazon.com/2023/9/amazon-and-anthropic-announce-strategic-collaboration-to-advance-generative-ai"&gt;Amazon-Anthropic partnership&lt;/a&gt;. Two years later, I&amp;rsquo;ve helped scale one of the fastest-growing AI services in AWS history.&lt;/p&gt;
&lt;p&gt;&lt;a href="https://aws.amazon.com/bedrock/"&gt;Amazon Bedrock&lt;/a&gt; processes millions of inference requests daily for Fortune 500 companies and startups alike. High availability, low latency, incredible rate of feature delivery (pre coding assistant era) required careful thought and management in a competitive market. In my first year, I helped launch the &lt;a href="https://aws.amazon.com/blogs/machine-learning/fine-tune-anthropics-claude-3-haiku-in-amazon-bedrock-to-boost-model-accuracy-and-quality/"&gt;model fine-tuning feature for Anthropic&amp;rsquo;s Claude models&lt;/a&gt; from private beta through GA. In my second year, I worked on Anthropic model inference services, maturing them into production-grade systems. I&amp;rsquo;ve since moved to AWS&amp;rsquo;s Agentic AI organization. My core motivation for writing this document stems from the quote &lt;em&gt;&amp;ldquo;You don&amp;rsquo;t learn from experiences, you learn by reflecting on your experiences&amp;rdquo;&lt;/em&gt;—a foresight my first manager in the industry instilled in me. My core reason for sharing these reflections broadly was inspired by the quote &lt;em&gt;&amp;ldquo;We make our living by what we get, but we make our life by what we give&amp;rdquo;&lt;/em&gt;.&lt;/p&gt;</description></item></channel></rss>