Data Engineer

Company Description: We are a progressive organization committed to leveraging data-driven insights to drive strategic decision-making and operational excellence. Currently, our payroll data infrastructure lacks the capability for seamless, holistic reporting and analysis, resulting in fragmented insights and inefficiencies. To address these challenges, we are embarking on a Unified Data Infrastructure project aimed at designing and implementing a robust data architecture that supports comprehensive reporting, integrates BI capabilities, and ensures data accuracy and accessibility.

Job Description: As a Data Engineer, you will collaborate closely with the Data Architect and cross-functional teams to build the foundational components of our unified data infrastructure. Your primary role will be to develop and maintain data pipelines, integrate raw data sources, and contribute to the establishment of a unified data model with standardized business logic. Key responsibilities include:

• Data Pipeline Development: Design, develop, and maintain scalable data pipelines to support data processing and integration from various sources into our data environment.
• Data Integration: Collaborate with the Data Architect to integrate raw data sources, potentially utilizing platforms like Databricks, ensuring data accuracy and consistency.
• Tool and Dashboard Development: Contribute to the development of tools, dashboards, and reports that utilize the unified data model and standardized business logic.
• Collaboration: Work closely with non-BI and senior team members to understand reporting requirements and implement solutions that meet business needs.
• Quality Assurance: Implement data quality checks and monitoring processes to ensure the integrity and reliability of data within the infrastructure.
• Documentation: Document data pipelines, data models, and technical specifications to facilitate knowledge sharing and ensure maintainability.
• Support and Optimization: Provide support for data-related issues, optimize data processing and integration workflows, and contribute to continuous improvement initiatives.

Qualifications:

• Experience: 4-6 years of experience as a Data Engineer or in a similar role, with hands-on experience in data pipeline development, ETL processes, and data integration.
• Technical Skills: Proficiency in programming languages such as Python, SQL, and experience with data manipulation and transformation tools. Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and data processing frameworks (e.g., Spark) is a plus.
• Problem-Solving Skills: Strong analytical and problem-solving abilities to troubleshoot data-related issues and optimize data workflows.
• Team Collaboration: Excellent interpersonal skills with the ability to work effectively in a collaborative team environment and communicate technical concepts to non-technical stakeholders.

**We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, color, ethnic origin, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.**

#LI-KH1