About Me
I'm Sahil Malik — a senior software engineer and AI systems architect at Amazon, based in Seattle. I work at the intersection of distributed systems, applied machine learning, and production AI platforms — translating research-grade ideas into reliable, scalable services that millions of people use every day.
Over nearly a decade at Amazon, I've led the design and delivery of Tier-1 ML inference services powering 30+ deep learning models at scale, executing zero-defect migrations across critical infrastructure. I built an NLU disambiguation system that resolves ambiguous voice requests for millions of customers monthly, and expanded ML-based routing across 11 locales and 8 languages. Currently I'm building agent AI systems and LLM-based products, contributing to next-generation AI initiatives including Alexa+ and enterprise agent platforms.
I'm a co-inventor on US Patent 12,494,194 B1 — a granted patent introducing incremental asynchronous neural inference architectures using model subgraphs, improving responsiveness in real-time speech and NLU systems.
Beyond production systems, I build applied AI platforms that solve real-world problems — including an AI-driven personal finance system using hybrid rule-based and LLM approaches, and vaani, a Hindi-keyword programming language expanding linguistic accessibility in computing. I also run a personal NVIDIA DGX Spark research lab with 15+ ML models spanning LLM orchestration, voice cloning, video generation, and autonomous agent systems.
I'm originally from Haryana, India. I studied Computer Engineering at NIT Kurukshetra (CGPA 8.99/10), interned at Amazon, and have been here ever since — growing from SDE-1 to Sr. SDE across 7 roles and teams.
Career Timeline
Sr. Software Development Engineer
Agent AI systems, LLM latency optimization, and developer tooling.
- •Significant latency reduction in LLM-based chat through parallelization and caching
- •Driving migration to modern agent frameworks
- •Built developer tooling for AI-assisted debugging with MCP integration
Sr. Software Development Engineer — Alexa+
LLM service architecture, agent orchestration, and cross-org technical leadership.
- •Demonstrated sub-2-second Alexa response latency in cross-team demos
- •Led technical support team for Alexa+ public launch event
- •Authored monolith-to-microservices architecture proposal reviewed by senior leadership
- •Drove cross-organization alignment across 6+ teams
Sr. Software Development Engineer
Self-learning arbitration systems and containerized microservices.
- •Built self-learning arbitration systems
- •Subject matter expert for containerized microservices and cloud infrastructure
Software Development Engineer II — Alexa AI
Founding member of an ML inference platform team. Grew the platform from serving a small fraction to 100% of Alexa voice traffic.
- •Delivered a production Tier-1 ML inference service hosting 30+ models
- •Built an NLU disambiguation feature serving millions of customers monthly
- •Expanded ML-based routing to 11 locales across 8 languages
- •Co-invented US Patent 12,494,194 B1 for ML inference architecture
Software Development Engineer II — Payments
Financial products platform development.
- •End-to-end owner of a customer differentiation module
- •Prototyped NoSQL migration for millions of customer records
Software Development Engineer I — Gift Cards
Gift card services, security features, and API development.
- •Built refund processing system impacting tens of thousands of customers
- •Designed and implemented security features for the gift card claim flow
- •Developed 5 APIs with >95% test coverage
Software Development Engineer Intern
Summer internship, converted to full-time offer.
B.Tech Computer Engineering
CGPA: 8.99/10.0
Bookshelf
A few books that shaped how I think about systems, people, and the world.
Systems & Leadership
- —Thinking in Systems
- —The Fifth Discipline
- —Staff Engineer
- —Hard Thing About Hard Things
Science & Curiosity
- —The Grand Design
- —Where Did the Universe Come From
- —Outlive
- —Sapiens
People & Communication
- —Thinking Fast and Slow
- —SuperCommunicators
- —Crucial Conversations
- —How to Win Friends and Influence People
- —The Laws of Human Nature
Self & Perspective
- —Atomic Habits
- —The Secret
- —Alchemy
- —Many Lives Many Masters
- —Same Soul Many Bodies
Plus: Introduction to Algorithms, Learning RxJava, Stocks to Riches, Life in Five Senses, and more.