SDE II - Data Engineer

InMobi (Corporate) InMobi Group is a global technology company shaping the future of agentic commerce and advertising. Through its ecosystem of businesses — including InMobi Advertising and flagship consumer platform Glance — InMobi leverages data, machine learning, and generative AI to help brands reach audiences more precisely and consumers discover products more intuitively. Glance, which is pioneering new models of agentic commerce, is owned and operated by Glance InMobi Pte. Ltd., a non-consolidated subsidiary of InMobi Pte. Ltd. InMobi Advertising InMobi Advertising, part of global technology company InMobi, is an agentic advertising platform helping brands and merchants achieve their business outcomes. Through its proprietary intelligence, AI-led solutions, and vast consumer reach — including flagship consumer platform Glance — InMobi Advertising delivers the omnichannel performance defining what's next in advertising and commerce. Glance is owned and operated by Glance InMobi Pte. Ltd., a non-consolidated subsidiary of InMobi Pte. Ltd. To learn more, visit advertising.inmobi.com. Glance Glance is an intelligent shopping agent, redefining the commerce experience. Powered by proprietary agentic intelligence and generative AI, Glance delivers a hyper-personalized consumer experience across mobile and TV — shaping the new era of shopping. Glance is operated by Glance InMobi Pte. Ltd., a non-consolidated subsidiary of global technology leader InMobi, and is backed by Mithril Capital, Google and Jio Platforms. To learn more, visit glance.com. Role Overview We are looking for a hands-on SDE-II – Data Engineer to join InMobi’s Demand-Side Platform (DSP) team. In this role, you will build, maintain, and optimise scalable data pipelines that support programmatic advertising, campaign analytics, audience targeting, and attribution. You will work with batch and streaming data, distributed processing frameworks, cloud data platforms, and analytical storage systems to transform large volumes of data into reliable and actionable insights. You will collaborate with backend, product, and ML engineering teams to develop efficient data solutions that support DSP operations. This role is ideal for an engineer with strong fundamentals in Python, SQL, and distributed data processing who is keen to solve data engineering challenges involving high-volume event streams, performance optimisation, and data reliability. Key Responsibilities 1. Data Engineering and Pipeline Development • Develop, maintain, and optimise end-to-end batch and streaming data pipelines for processing events such as bid requests, impressions, clicks, and conversion signals. • Build data ingestion and transformation workflows using Python, SQL, Apache Spark/PySpark, and relevant data engineering frameworks. • Work with data lakehouse architectures and contribute to ingestion, storage, transformation, and serving layers. • Implement data quality checks, schema validation, error handling, and monitoring to ensure data accuracy and reliability. • Support data modelling and query optimisation for analytical and reporting workloads. • Contribute to pipeline performance improvements, resource utilisation, and efficient compute and storage usage. 2. Distributed Processing and Streaming • Work with distributed data processing technologies such as Apache Spark, PySpark, and Apache Kafka. • Develop and support streaming workflows for processing event-driven data, with attention to data freshness, reliability, and processing efficiency. • Implement mechanisms for handling duplicate, delayed, or failed events, including retries, checkpointing, and recovery where applicable. • Investigate production issues and troubleshoot data pipeline failures, performance bottlenecks, and data quality discrepancies. • Contribute to the adoption and effective use of technologies such as Apache Flink, Spark Structured Streaming, and open table formats where relevant to the platform. 3. Data Storage and Analytics • Work with cloud-based data platforms and storage services to support scalable data processing and analytics. • Develop and optimise SQL queries, data transformations, partitioning strategies, and table structures. • Contribute to analytical data stores such as StarRocks, ClickHouse, or similar technologies, based on project requirements. • Work with data lake table formats such as Apache Iceberg, Delta Lake, or Apache Hudi, where applicable. • Support data modelling, metadata management, access controls, and data retention practices in line with established engineering standards. 4. Collaboration and Engineering Practices • Collaborate with backend engineers, ML engineers, and other stakeholders to understand data requirements and deliver reliable data solutions. • Work with workflow orchestration tools such as Apache Airflow or equivalent to schedule, monitor, and manage data pipelines. • Participate in code reviews, technical discussions, testing, and deployment activities. • Follow engineering best practices for version control, CI/CD, observability, documentation, and production readiness. • Contribute to continuous improvement by identifying opportunities to enhance pipeline reliability, scalability, performance, and cost efficiency. Required Skills and Qualifications Experience and Education • 2–5 years of experience in software engineering, data engineering, or big data development. • Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field. • Experience developing and maintaining data pipelines in a production environment. • Experience handling large datasets or distributed data processing workloads is preferred. • Exposure to ad-tech, programmatic advertising, real-time bidding (RTB), or event-driven systems is an added advantage. Core Data Engineering Skills • Strong programming skills in Python. • Good command of SQL, including join