Responsibilities:

• Design, build, and maintain scalable data pipelines in Databricks.
• Collaborate with cross-functional teams to gather and interpret data requirements.
• Develop data models and perform data analysis using SQL and Python.
• Implement and optimize ETL processes for data ingestion and transformation.
• Monitor and troubleshoot data pipeline issues to ensure data integrity and availability.
• Create data visualizations and dashboards to present findings to stakeholders.
• Stay up-to-date with the latest features and best practices in Databricks and big data technologies.

Requirements:

• Proficiency in Databricks and experience with Apache Spark.
• Strong knowledge of SQL and Python programming languages.
• Experience in data modeling, ETL processes, and data warehousing.
• Familiarity with cloud platforms like AWS, Azure, or Google Cloud.
• Ability to handle large datasets and perform data analysis efficiently.
• Excellent problem-solving and analytical skills.
• Strong communication skills and a collaborative mindset.