hireejobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Senior Data Engineer

3.00 to 8.00 Years   Bangalore   14 Oct, 2020
Infoblox
Job LocationBangalore
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT - Hardware / Networking
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

Description Infoblox is looking for a Senior Data Engineer to augment our Cyber Security Data Science Team. This growing team supports the Infoblox mission to thwart cybersecurity threats in our customer s networks. This role reports into Manager, Data Science based out of Tacoma, Washington. This is an opportunity to work closely with data scientists and threat analysts to curate the data that makes this mission possible.The ideal candidate is a savvy software engineer with experience in data engineering and a solid background in Spark and Python. Preferably you know that count MinSketch is not a children s game.You are comfortable wearing several hats in a small organization with a wide range of responsibilities, and have worked in a cloud environment, such as Amazon EMR. You know that Big Data is both a blessing and a curse; without good data engineering it loses its potential. You are passionate about the nexus between data and computer science -- driven to figure out how best to represent and summarize data in a way that informs good decisions and drives new products. When someone says, my Spark job failed , your first question is what s the skew . Come join our growing Cyber Threat Intelligence team and help us build world-class solutions! Responsibilities:

  • Curate very large-scale data from a multitude of sources into appropriate sets for research and development for the data science, threat analysts, and developers across the company
  • Design, test, and implement storage solutions for various consumers of the data
  • Design and implement mechanisms to monitor data sources over time for changes using summarization, monitoring, and statistical methods
  • Leverage computer science algorithms and constructs, including probabilistic data structures, to distill large data into sources of insight and enable future analytics
  • Convert prototypes into production data engineering solutions through disciplined software engineering practices, Spark optimizations, and modern deployment pipelines
  • Collaborate on design, implementation, and deployment of applications with the rest of software engineering
  • Support data scientists and threat analysts in building, debugging and deploying Spark applications that best leverage data
  • Build and maintain tools for automation, deployment, monitoring, and operations
  • Create test plans, test cases, and run tests with automated tools
Requirements:
  • 6 years of experience with Python3, and 2 years experience with Spark. Scala experience is required
  • 5 years of experience in data engineering, data science, and related data-centric fields using large-scale data environments
  • 3 years of experience in using SQL and working with modern relational databases, including MySQL or PostgreSQL
  • 3 years of experience with developing ETL pipelines and data manipulation scripts
  • Proficient in Object-Oriented Design and S.O.L.I.D principles
  • Strong emphasis on unit testing and code quality
  • Proficient with AWS products (EMR S3, Lambda, VPC, EC2, API Gateway, etc)
  • Very strong Python and PySpark experience
  • Very strong back end development experience
  • Strong experience with cloud deployments and CI/CD
  • Experience with virtualization, containers, and orchestration (Docker, Kubernetes, XEN)
  • Experience with NoSQL Non-Relational databases (AWS DynamoDB)
Education:
  • MS or BS in Computer Science or a related field, or equivalent work experience required
,

Keyskills :
data structuressqlcomputer scienceunit testingcontent managementemailtest casescyber securityanalyticsdata sciencebig dataapachesoftware engineering practicesresearch development

APPLY NOW

Senior Data Engineer Related Jobs

© 2019 Hireejobs All Rights Reserved