Data Engineer
Octus is seeking a Data Engineer to design, develop, and lead scalable data ingestion and transformation pipelines. This role is integral to maintaining robust data infrastructure that powers data platforms, products, and automation initiatives across the firm. The ideal candidate is an expert Python and SQL developer with deep experience building modern data workflows using AWS services and infrastructure-as-code.
Key responsibilities include leading the design and development of data ingestion and transformation pipelines, ensuring scalability, efficiency, and reliability across diverse data sources such as APIs, web data, and internal feeds. The Data Engineer will architect and manage data pipelines and orchestration workflows using AWS services like MWAA (Airflow), Lambda, ECS, and SQS. Additionally, the role involves implementing and maintaining infrastructure as code using Terraform, ensuring reproducibility and compliance with cloud standards.
The position requires a strong foundation in software engineering principles, including SOLID design, modularity, and scalability. Expert proficiency in Python for data pipeline and automation development, along with advanced SQL skills and experience optimizing complex queries and data models, is essential. Candidates should have proven experience designing and maintaining cloud-native data pipelines on AWS and implementing infrastructure as code frameworks. Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices is also required.
Octus offers competitive health benefits, matched 401k and pension plans, PTO, generous parental leave, gym subsidies, educational reimbursements for career development, recognition programs, and pet-friendly offices in the US. The company fosters a culture that values action orientation, a customer-first mindset, effective teamwork, and a drive to excel. Employees are encouraged to innovate and contribute to the company's mission of providing clear and actionable credit intelligence.