We are seeking an experienced Data Platform Engineer responsible for designing, constructing, and maintaining our suite of data platforms. This includes cloud-based data warehouses, business intelligence tools, and data science applications. A successful candidate ensures the platforms' optimal performance, scalability, reliability, and security, providing guidance and support to our team of data engineers, scientists, and analysts.
Responsibilities:
- Design, implement and manage efficient data platforms conforming to industry standards and best practices.
- Develop and automate data workflows and pipelines across various data sources and platforms.
- Troubleshoot and correct data platform issues, including performance, security vulnerabilities, and data quality problems.
- Constantly monitor and optimize platform performance, availability, and capacity using relevant tools and metrics.
- Assess new technologies and trends in the data platform industry, providing recommendations for improvements and innovation.
- Collaborate closely with other data platform engineers, data analysts, data scientists, and business stakeholders to understand and meet their data platform needs.
- Minimum 5 years of experience in data platform engineering or a similar role, preferably in a cloud-based environment.
- Proficiency in Python, SQL, and other programming languages along with experience using cloud data warehouses like Snowflake.
- Skilled in deploying and managing CI/CD pipelines, optimizing collaboration using platforms such as Azure DevOps.
- Familiarity with business intelligence tools, data science tools, and data intelligence tools.
- Understanding of data platform architectures, design principles and best practices, and data platform security compliance and governance standards.
- Excellent communication, collaboration, and problem-solving skills.
Desirable Qualities:
- Knowledge of regulations including GDPR, CCPA, and HIPAA.
- Experience managing code and application releases through technologies similar to Octopus Deploy.