Sr. Data Engineer.

Duration: Long Term.

Location: Chicago, IL. (Hybrid).

NOTE: Should have strong hands-on experience working on Azure, Databricks, Spark, PySpark.

Key Skill: proficient in writing high-quality Pyspark code and experienced in contributing to the development of frameworks that streamline repetitive tasks.

• Responsible for designing and developing of data solutions that are strategic for the business and built on the latest technologies and patterns.
• Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements Develop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build structure for previously unstructured data
• Develop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build structure for previously unstructured data
• Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities
• Develop data lake solution to store structured and unstructured data from internal and external sources and provide technical guidance to help migrate colleagues to modern technology platform
• Contribute and adhere to CI/CD processes, development best practices and strengthen the discipline in Data Engineering Org
• Mentor other members in the team and organization and contribute to organizations' growth.