Software Engineer, Distributed Systems
As a Software Engineer specializing in Distributed Systems at fal, you will be instrumental in developing and scaling our core Python and Rust platforms. This role involves working on critical components such as request routing, AI workload orchestration, scheduling, GPU autoscaling, large-scale file storage, and queueing systems. You will collaborate closely with cross-functional teams to design forward-thinking solutions that can handle exponential traffic growth while maintaining low latency across global operations.
Your primary responsibilities will include building and enhancing our distributed computing infrastructure, focusing on reliability and scalability with minimal operational overhead. You will leverage AI to automate routine tasks, ensuring the robustness of complex systems. Additionally, you will profile and optimize low-level CPU and memory performance to enhance system efficiency.
The ideal candidate will have over three years of experience in developing distributed compute and orchestration platforms using Python or Rust. A strong understanding of distributed systems fundamentals—such as consensus algorithms, scheduling, fault tolerance, and capacity planning—is essential. Proficiency in computational complexity and memory allocation, along with a proven track record of designing systems that perform under real production loads, is required. Experience with observability tools to drive performance and reliability decisions, excellent communication skills, and the ability to lead technical decisions across teams are also crucial.
Compensation for this position ranges from $180,000 to $250,000 annually, depending on experience and level, and includes equity and benefits. We are currently hiring in downtown San Francisco and offer relocation assistance. Health, dental, and vision insurance are provided, along with regular team events and offsites to foster a collaborative and engaging work environment.
At fal, we are committed to providing interesting and challenging work with ample learning and growth opportunities. Our company culture emphasizes innovation, collaboration, and continuous improvement, making it an ideal environment for professionals looking to advance their careers in distributed systems engineering.