Software Developer - Data
IMC is seeking an experienced Software Developer to join our Mumbai team, focusing on the development and deployment of our Big Data environment. This role is integral to maintaining IMC's position at the forefront of the evolving global financial markets.
Key responsibilities include architecting, developing, and deploying our Big Data environment utilizing technologies such as Kafka, Hadoop, and Dremio. The role also involves building, deploying, and monitoring data processing pipelines using Java, Python, Spark, and Flink. Collaboration with development teams on data modeling, data ingestion, and capacity planning is essential, as well as ensuring data integrity and availability for users. Additionally, the developer will act as a Big Data subject matter expert, consulting on various data-related questions from users and developers.
The ideal candidate will have over 5 years of experience in a mature data engineering environment, with at least 3 years dedicated to building Kafka streaming applications and/or maintaining Kafka clusters. A minimum of 2 years of experience in building applications or pipelines with Big Data backends such as S3, HDFS, Databricks, or Iceberg is required. Proficiency in Apache Spark, Apache Flink, or similar tools, along with strong development skills in Java, Python, and SQL, is essential. Experience with common data-science toolkits, particularly those that are Python-based, is also desirable. Hands-on experience with Kubernetes and Docker, as well as familiarity with monitoring tools like Prometheus/Grafana, Alert Manager, Alerta, and OpsGenie, is beneficial. Strong statistical analysis skills, demonstrated ability to troubleshoot and conduct root-cause analysis, and Unix scripting experience (bash, Python, etc.) are also required.
IMC offers a collaborative and high-performance culture, providing opportunities for professional growth and development. Employees are encouraged to innovate and contribute to the firm's success in the global financial markets.