We are seeking an experienced and highly skilled Senior Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure. You will collaborate with data scientists, analysts, and other engineers to ensure efficient data integration, transformation, and delivery. The role requires expertise in big data technologies, ETL processes, and cloud-based data platforms. Key Responsibilities: Design, develop, and maintain scalable data pipelines for data extraction, transformation, and loading (ETL/ELT). Build and optimize data models to support analytical and reporting needs. Develop and maintain data integration solutions from various sources (structured, semi-structured, and unstructured data). Implement and manage data warehousing solutions (e.g., Snowflake, Redshift, BigQuery, Databricks). Optimize and troubleshoot big data processing workflows. Collaborate with data scientists and analysts to provide reliable and accurate datasets. Ensure data quality, integrity, and accuracy by implementing validation and monitoring processes. Automate data processes using Python, Spark, or Scala. Work with cloud platforms (AWS, Azure, or GCP) for data storage and processing. Implement and monitor CI/CD pipelines for data infrastructure. Ensure compliance with data governance and security standards. Required Skills: 5+ years of experience in data engineering or related field. Strong proficiency in SQL for data extraction and transformation. Experience with ETL/ELT tools (e.g., Apache Airflow, Apache NiFi, DBT, Talend). Hands-on experience with big data processing frameworks (Spark, Hadoop, or Kafka). Proficiency in Python, Scala, or Java for data processing. Experience with cloud data platforms (AWS, Azure, or GCP). Strong knowledge of data modeling, data lakes, and data warehousing concepts. Familiarity with streaming data pipelines and real-time processing. Hands-on experience with CI/CD pipelines and version control (Git, GitLab, or Bitbucket). Experience with data governance and security practices. Strong problem-solving and analytical skills.
Benefits: Competitive salary and performance-based bonuses. Health insurance and paid time off. Flexible work hours and remote/hybrid options. Professional development and training opportunities. Collaborative and growth-oriented work environment
