ByJob Title: Data Engineer
Location: Remote (India)
Category: IT and Engineering
Employment Type: Full-time
Company Overview:
CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. With over 40 years of experience, CAI excels in uniting talent and technology to deliver innovative solutions across various sectors. As a privately held company, CAI prioritizes doing what is right and fosters an environment of freedom and focus. CAI is committed to bringing neurodiversity to the enterprise and creating lasting results for its clients, colleagues, and communities.
Job Summary:
We are seeking a full-time Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data operations. This position offers the flexibility of remote work.
Responsibilities:
- Participate in the design and development phases of projects.
- Apply analytical and technical skills to optimize data operations.
- Ensure data quality and validation.
- Collaborate with team members and data experts to streamline processes.
- Handle production and administration activities.
Requirements:
- Minimum of 2 years’ experience working with Spark and DataFrames using Python.
- Experience in writing batch pipelines using Spark.
- Proficiency in handling semi/unstructured data using PySpark or Python.
- Familiarity with Delta Lake.
- Proficient in performance optimization techniques for Spark jobs.
- Experience with DevOps environments is advantageous.
- Strong proficiency in testing methodologies and validating data pipelines.
- Proficient in SQL and database management systems.
- Experience working with Data Lakes, Star Schemas, etc.
- Demonstrated capability in constructing scalable data pipelines and ETL processes.
- Familiarity with data warehousing, data quality assurance, and monitoring practices.
- Working knowledge of at least one public cloud platform, preferably Azure.
Physical Demands:
- Sedentary work primarily involving sitting or remaining stationary, with occasional movement around the office for meetings, etc.
- Ability to perform repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor.
Reasonable Accommodation Statement:
If you require a reasonable accommodation during the application process, interviews, pre-employment testing, or any other aspect of the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.
Apply Now: CAI is Hiring Data Engineer
