Job Title: Data Engineer

Position Type: Contract (only on W2, day-1 onsite)

Experience: 8+yrs

Location: Plano, TX

Job Description:

• Experience of Hadoop and Spark ecosystems including HDFS, Hive, Tez, Spark, Yarn. Proficiency with SQL, Azure Data Factory, and API integration.
• Experience of using Databricks.
• Good experience working on Azure Cloud environment.
• Experience in broad technology delivery, including custom software development using various programming languages.
• Experience in driving technical planning and solutions, including developing software designs, managing vendor evaluations, and justifying technical recommendations.
• Experience developing data quality checks and reporting to verify ETL rules and identify data anomalies.
• Understanding of SQL and No SQL statement optimization/tuning.
• Techniques for testing ETL data pipelines either manual or using tools.
• Strong analytical skills and the ability to systematically resolve technical and organizational challenges.