Data Engineer is hiring for Software Engineer

www.djobbuzz.com 20 Jul 2024

Job Type

Job Location

Education

Branch

Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience as a Data Engineer or similar role, with expertise in Databricks.
Technical expertise with data models, data mining, and segmentation techniques
Strong programming skills in languages such as Python.
Experience with big data technologies such as Hadoop, Spark, or Kafka.
Proficiency in SQL and database technologies (e.g., MySQL, PostgreSQL, or Oracle).
Familiarity with cloud platforms (e.g., AWS, Azure, or GCP) and their data services.

Design, build, and maintain scalable data pipelines and ETL processes using Databricks to collect, transform, and load data from various sources into our data warehouse.
Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and implement solutions to meet their needs using Databricks.
Prepare data for the advanced analysis e.g. ML modeling
Optimize and tune data pipelines and ETL processes in Databricks for performance and efficiency.
Develop and maintain data models, schemas, and data dictionaries in Databricks.
Implement data quality checks and monitoring in Databricks to ensure data accuracy and integrity.
Troubleshoot and resolve data-related issues and incidents in Databricks.