Job description
Senior Data Engineer
Primary Responsibilities:
- Responsible for developing and maintaining applications with PySpark • Contribute to the overall design and architecture of the application developed and deployed.
• Performance Tuning wrt to executor sizing and other environmental parameters, code optimization, partitions tuning, etc.
• Interact with business users to understand requirements and troubleshoot issues.
• Implement Projects based on functional specifications
Must-Have Skills:
OVERALL EXPERIENCE SHOULD BE 6- 10 YEARS & RELEVANT AND BANKING DOMAIN EXPERIENCE SHOULD BE MINIMUM 3 YEARS
• Good experience in Pyspark – Including Dataframe core functions and Spark SQL
• Good experience in SQL DBs – Be able to write queries including fair complexity.
• Should have excellent experience in Big Data programming for data transformation and aggregations
• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.
• Good customer communication.
• Good Analytical skills
=>Any cloud experience is mandatory.
Perks and Benefits:- Work Visa Sponsorship UAE
Medical insurance
Role: Technical Support Engineer
Industry Type: IT Services & Consulting
Functional Area: IT Software – DBA, Datawarehousing
Employment Type: Full Time, Permanent
Role Category: Admin/Maintenance/Security/Datawarehousing
Education
UG :B.Tech/B.E. in Any Specialization