Data Software Engineer

Job Description

Key Skills: Adb, Azure Databricks, Azure, Python, SparkRoles and Responsibilities:Develop and maintain data processing systems using Azure Databricks and other Big Data technologies.Lead the design and implementation of scalable data solutions, ensuring high performance and reliability.Collaborate with cross-functional teams to integrate data from various sources, including RDBMS and NoSQL databases.Utilize Apache Spark for data processing and performance tuning of Spark jobs.Implement stream-processing systems using technologies such as Apache Storm or Spark-Streaming.Manage messaging systems like Kafka or RabbitMQ for efficient data flow.Conduct performance tuning and optimization of data queries and processes.Apply Agile methodologies to enhance project delivery and team collaboration.Mentor and lead junior team members in best practices and technical skills.Skills Required:Azure Data Engineering (Azure Databricks, ADB)Distributed Data Processing (Apache Spark)Data Integration (RDBMS & NoSQL)Stream Processing (Spark-Streaming, Storm)Messaging Systems (Kafka, RabbitMQ)Performance Tuning & OptimizationAgile Development PracticesEducation: Bachelor’s degree in Computer Science, Information Technology, or a related field