ByAbout Flipkart: Flipkart is at the forefront of transforming commerce in India through innovative technology solutions, customer-centric features, a diverse category landscape, and a world-class supply chain. With a customer base exceeding 350 million and product coverage of over 150 million across 80+ categories, Flipkart is committed to creating direct and indirect employment opportunities, empowering entrepreneurs and MSMEs, and promoting sustainable growth. As a Walmart-owned group, Flipkart includes Flipkart Health+, Myntra, and Cleartrip, and is a majority shareholder in PhonePe, a leading payments app in India.
Job Description: As a Data Engineer, you will be responsible for building data analytical solutions to address complex business questions. You will design, prototype, and implement data products that support data processing, data science, and analytics needs. You will work closely with data scientists, product managers, and the data platform team to understand functional data requirements and leverage the underlying tech stack to create scalable, robust data applications capable of processing terabytes of data in real-time. The data products and applications you build will facilitate data-driven decision-making across business, analytics, and operations.
Skills Required:
- Data Engineering
- Data Pipeline
- Spark
- SQL
- Java
- SCALA
- Kafka
- HBase
- Hive
- Hadoop
- Airflow
Role:
- Design, implement, and operate stable, scalable solutions to flow data from production systems into analytical data platforms (big data tech stack + MPP) and end-user-facing applications for both real-time and batch use cases.
- Collaborate with business customers in a fast-paced environment to understand business requirements and implement analytical solutions.
- Design, create, manage, and utilize large datasets. Perform high-level design with guidance; functional modeling, module breakdown, platform thinking, and reuse.
- Build and execute data modeling projects across multiple tech stacks (big data, MPP, OLAP) using agile development techniques. Integrate robust data processing pipelines for enterprise-level business analytics.
- Challenge the status quo and propose innovative methods for data processing, modeling, and consumption, considering tech stack choices and design principles.
- Assist other staff with reporting, debugging data accuracy issues, and related functions as needed.
- Develop automated monitoring, alerting, and self-healing features while building consumption pipelines. Translate business requirements into technical specifications (facts, dimensions, filters, derivations, aggregations).
Ideal Candidate:
- Excellent communication skills to work with engineering, product, and business owners to develop and define key business questions and build data sets that answer those questions.
- Passion for working with large data sets and integrating datasets to answer business questions and drive change.
Qualifications:
- 3-5 years of experience with a Bachelor’s Degree in Computer Science, Engineering, Technology, or a related field.
- 2-3 years of relevant software development experience with skills in database modeling (relational, multi-dimensional), optimization, and data architecture (e.g., Vertica).
- Understanding of streaming technologies like Kafka, Spark Streaming.
- Proficiency in programming languages like Java, Scala, or Python.
- Knowledge of Agile, SDLC/CICD practices, and distributed systems.
- Experience with Enterprise Business Intelligence Platform/Data platform sizing, tuning, optimization, and system landscape integration in large-scale, enterprise deployments.
- Proven experience with Hadoop, MapReduce, Hive, Spark, Scala programming.
- In-depth knowledge of performance tuning/optimizing data processing jobs and debugging time-consuming jobs.
- Development experience in conceptual, logical, and physical data models for Hadoop, relational, EDW (enterprise data warehouse), and OLAP database solutions.
- Experience working extensively in multi-petabyte DW environments and engineering large-scale systems in a product environment.
Location: Bangalore, Karnataka
Desirable Skills:
- Data warehousing
- Data Modeling
- GCP
- Bigtable
- Bigquery
- Dataproc
- Pubsub
Role Responsibilities:
- Manage the end-to-end data journey by overseeing the infrastructure, services, and data pipelines in a distributed environment.
- Join a team of 6 data engineers to build the next-generation infrastructure and services for the data platform.
Why Work with Us? At Flipkart, we maximize what you care about the most. You’ll have the opportunity to leave a mark, create your legacy, experiment, learn, and grow. Work with the best in inclusive teams and experience our culture of care, ensuring you can focus on your best work. Every Flipster is a Maximizer: curious, audacious, entrepreneurial, purpose-driven, excited by big challenges, a team player, and inclusive. If this is you, Flipkart is where you can thrive.
Being Yourself @ Flipkart: Flipkart respects and values differences and is proud to be an equal opportunity employer. We are committed to promoting a diverse workplace culture where every individual is valued, regardless of race, color, age, faith, gender identity or expression, sexual orientation, nationality, marital status, professional pedigree, physical ability, veteran status, or any other characteristics. Diverse teams innovate and excel every day.
Apply Now: Flipkart Hiring: Data Engineer II Position
