Databricks Azure Data Engineering

8.00 to 12.00 Years Noida,Other Uttar Pradesh 28 Jun, 2024

Job Location	Noida,Other Uttar Pradesh
Education	Not Mentioned
Salary	Not Disclosed
Industry	IT Services & Consulting
Functional Area	Not Mentioned
EmploymentType	Full-time

Job Description

POSITION TITLE: Senior Data Brick EngineerLOCATION: Sector 44, Gurugram, IndiaPosition Overview: We are seeking a highly skilled and experienced Senior Databricks Engineer to join our dynamic data engineering team. The ideal candidate will have a strong background in Databricks, Azure, and SaaS products. This role involves designing, implementing, and optimizing data solutions using Databricks on Azure to support our data-driven initiatives.Key Responsibilities Design and Development: Design, develop, and optimize large-scale data processing pipelines using Databricks on Azure. Implement ETL processes to ingest and transform data from various sources into our data platform. Develop scalable and efficient data models to support analytics and reporting needs. Azure Integration: Integrate Databricks with Azure services such as Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, and Azure Machine Learning. Utilize Azure DevOps for continuous integration and. continuous deployment (CI/CD) of data solutions. SaaS Product Exposure: Collaborate with product teams to understand data requirements and integrate SaaS product data into the data platform. Develop data solutions that support SaaS product analytics and reporting. Performance Optimization: Monitor and optimize the performance of data pipelines and queries. Implement best practices for data governance, security, and compliance. Collaboration and Leadership: Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions. Mentor and guide junior engineers, promoting best practices and knowledge sharing within the team. Documentation and Reporting: Maintain comprehensive documentation of data engineering processes, designs, and solutions. Generate reports and dashboards to provide insights into data platform performance and usage.QualificationsEducation: Bachelors or Masters degree in Computer Science, Engineering, or a related field. Experience: Minimum of 8-10 years of experience in data engineering or related roles. Extensive experience with Databricks and Azure. Proven experience with SaaS products and integrating their data into data platforms. Technical Skills: Proficiency in Spark, SQL, Python, and Scala. Strong understanding of Azure services and architecture. Experience with data warehousing, ETL/ELT processes, and data modeling. Knowledge of CI/CD practices and tools, particularly Azure DevOps. Soft Skills: Excellent problem-solving and analytical skills. Strong communication and collaboration abilities. Ability to work independently and lead projects.Preferred Qualifications Certifications in Databricks, AWS, Azure, or related Cloud technologies. Experience with machine learning and AI integration. Familiarity with data visualization tools like Power BI or Tableau.Benefits Competitive salary and performance-based bonuses. Comprehensive health insurance including Parents Complementary Buffet Meal Everyday Professional development opportunities and continuous learning.Join our team and contribute to the development of high-quality business applications,

Keyskills :
AzureSparkSQLPythonScalaDatabricks

APPLY NOW