Spurtree Technologies Hiring Data/Senior Data Engineer

Job Summary

We are seeking a highly skilled and motivated Business Intelligence and Data Engineering Specialist to join our team. In this dual-role position, you will transform data into actionable insights and ensure the robustness and efficiency of the data pipelines in ETL and BI projects. You will collaborate with various departments to design, develop, and maintain business intelligence solutions, dashboards, reports, and data engineering processes. This role requires analytical skills, technical proficiency, and the ability to communicate complex data concepts to non-technical stakeholders.

Required Skills

As a Data Engineer, you should have experience in the following areas:

Data Analysis

Analyze and interpret complex datasets to identify trends, patterns, and insights.
Develop and maintain data models, data warehouses, and data cubes.

Data Integration

Develop and maintain robust data pipelines, ETL processes, and data integration solutions.
Ensure data accuracy and consistency through data quality checks and data cleansing processes.

Data Architecture

Design and maintain data architecture, including data lakes and warehouses.
Strong understanding of data modeling, database design, and SQL.
Implement data governance best practices.

Data Engineering Best Practices

Stay up-to-date with best practices and emerging technologies.
Improve data engineering processes and enhance data reliability.

Performance Optimization

Monitor and optimize data pipeline performance.
Troubleshoot and resolve technical issues related to BI tools and data sources.

Collaboration

Collaborate with cross-functional teams to gather requirements.
Train and support end-users in utilizing BI tools and understanding data outputs.

Data Governance

Implement best practices, including data security, data lineage, and cataloging.
Ensure compliance with data privacy regulations and company policies.

Continuous Improvement

Stay updated on industry trends and best practices in business intelligence and data analytics.
Recommend enhancements to existing BI solutions.

Data Visualization

Visualize data effectively using charts, graphs, and other techniques.
Develop and maintain a library of standard visualizations.

Reporting and Dashboard Development

Design, create, and maintain interactive dashboards and reports using BI tools like Tableau or Power BI.
Collaborate with end-users to understand their reporting needs.

Platforms and Tools

Proficiency in programming languages such as Python, Scala, or C#.
Experience with Azure (Azure Data Factory, Azure Databricks, Azure Synapse Analytics) or AWS (AWS Glue, AWS Lambda, AWS Redshift).
Experience with big data technologies like Hadoop, Spark, or Kafka.
Experience with Power BI.

Qualification Criteria and Skills

Relevant experience in data engineering.
Graduation/Post Graduation in Computer Science or a relevant degree.
Industry-recognized certifications are an added advantage.

Role Responsibilities

Be a first-class citizen in a high-performance software development team.
Design, build, and maintain scalable and reliable data pipelines.
Collaborate with cross-functional teams to gather and understand data requirements.
Implement data integration solutions.
Optimize and tune data pipelines for performance, reliability, and cost efficiency.
Provide technical leadership and mentorship to junior members.
Stay updated on emerging technologies and best practices.
Take quality ownership for all deliveries.

Responsibilities Towards Self, Team, and Company