Senior Software Engineer, Go - LLM Team

AssemblyAI is seeking a Senior Software Engineer to join their LLM team, focusing on developing and maintaining a unified API platform that connects customers to multiple LLM providers. This role is integral to enhancing AI and agentic workflows, ensuring reliable access to optimal models for various use cases.

Key responsibilities include collaborating closely with the customer success team to understand and address customer challenges, optimizing prompt strategies, and building features that improve customer workflows. The engineer will also be responsible for integrating with multiple LLM providers, writing clean and maintainable code, designing scalable solutions, and participating in on-call rotations to ensure service reliability.

The ideal candidate will have over five years of professional software engineering experience, with strong proficiency in Go. Experience with LLM APIs, API gateways, and prompt engineering concepts is essential. A solid understanding of software engineering fundamentals, including data structures, system design, and testing strategies, is required. Additionally, experience with RESTful APIs, distributed systems, SQL databases, version control, and cloud infrastructure is beneficial.

AssemblyAI offers a competitive salary range of $180,000 to $240,000, along with equity grants, 100% employer-paid benefits, and a 401(k) match up to 4% for U.S.-based full-time team members. The company operates fully remotely, providing flexibility and support for a balanced work-life experience.

As a remote team of startup veterans and AI researchers, AssemblyAI fosters a culture of ambition, curiosity, and integrity. Employees are encouraged to bring their full selves to work, with equal opportunities to succeed. The company values diversity and inclusivity, aiming to build a team that represents a wide variety of backgrounds and perspectives.