Job Description

Our client is actively searching for experienced candidates in the tech space. They are one of the leading businesses in the industry and looking for a talented Data Engineer who is passionate and looking for a new challenge in a tech industry that is growing largely

Job Responsibilities

• Work closely with the DevOps and Business Intelligence teams to provide an open platform for data processing and analytics.
• Collaborate w/ software developers and data scientists to support model development and validation as well as data analysis.
• Create and put into practice data storage solutions to guarantee data reliability, accessibility, and scalability.
• Observe data infrastructure\'s performance and make necessary adjustments to boost productivity and improve business cost
• Take part in team-wide technical conversations through code reviews, RFC sessions, or architecture review meetings.

• 4+ years of Data Engineer experience
• Deep understanding of DevOps and Agile principles, including version control, CI/CD infrastructure-as-code, containerization, and observability/monitoring.
• Working knowledge of developing data infrastructure to meet the demands of business and data teams. strong data modeling, data architecture, and data warehousing understanding.
• Understand data processing systems like Airflow, Dagster, Flyte, Spark, DBT, or comparable ones, as well as data cataloging tools like Atlas, Amundsen, DataHub, or comparable ones.
• Experienced with NoSQL databases and SQL (PostgreSQL is preferable) (Redis, Elasticsearch preferred).
• Familiar with Redshift, Athena, Glue, and EMR. knowledge of data platforms like Sagemaker, Dataiku, Databricks, and Datarobot, among others.
• Expertise in data reporting and visualization software, such as Metabase, Tableau, PowerBI, or Looker.

• Practical experience supporting consumer apps with heavy traffic.
• Working knowledge of tools like Kafka, Flink, or others for real-time data processing. Data science, MLOps, or comparable training or employment.

NodeFlair