We are looking for a talented Lead Data Engineer to join our team. In this role, you will be responsible for building and optimizing data pipelines, conducting complex data analysis, documenting processes and data, and applying a software development approach to data engineering problems. This role is based in Morristown, New Jersey, and it offers an exciting opportunity for those who are passionate about data engineering and the tech industry.

Responsibilities:

• Develop and optimize data pipelines using industry-standard coding practices, modern design patterns, and architectural principles
• Conduct comprehensive data analysis, prepare data for prescriptive and predictive modeling, and combine raw information from different sources
• Develop and maintain comprehensive documentation for processes and data
• Monitor data pipeline processes and perform necessary triage
• Write unit and integration tests, research problems discovered by quality assurance or product support, and develop solutions to address these problems
• Apply software development principles to data engineering problems, including testing, documentation, modularity, and dry-ness, and CI/CD workflow
• Leverage programming languages such as Python, SQL, Java, and Shell scripting
• Utilize cloud computing platforms such as AWS
• Ensure the security, backup, and recovery procedures of databases
• Use Data Visualization tools such as Looker, Mode, Sigma, and ThoughtSpot
• Employ strong communication and collaboration skills to work effectively within the team
• Exhibit excellent problem-solving and troubleshooting skills.• Proven experience in a Lead Data Engineer role or similar capacity.
• Demonstrable expertise in Apache Kafka, Apache Spark, and Cloud Technologies.
• Proficiency in working with databases and EO/IR systems.
• Experience in implementing algorithms and analytics.
• Familiarity with Apache Hadoop and API Development.
• Knowledge of AWS Technologies and Fedwire.
• Proficiency in Nacha.
• Strong problem-solving skills with a keen eye for detail.
• Excellent communication and leadership skills.
• A degree in Computer Science, Data Science, or related field.
• Ability to work collaboratively in a team environment.
• High level of professionalism and ethical standards.
• Commitment to continuous learning and skill development.