A well-established Financial Service Provider is seeking a Big Data developer in Johannesburg.

Role Purpose: To join a team on a major drive to develop a new way of doing business.

Minimum Requirements

• Matric
• IT Qualification or relevant certification
• Experience in production development in Big Data environment, both batch and real time
• Hadoop, Apache Spark, Scala and Spark SQL essential
• Java or Python development experience an advantage
• Strong SQL essential (Netezza SQL or any other DB)
• Ability to optimize calculations, to do complex aggregation of data necessary
• Financial services background preferred
• Optimizing scripts for better performance

Responsibilities:

• Manage infrastructure that provides insight from raw data and handles diverse sources of data
• Understand, comply and implement all steps within IT development and Support software development environments
• Implementing complex Big Data projects with a focus on collecting, parsing, managing, analysing and visualizing large sets of data using Spark or Scala
• Extract data from relational databases or Mainframe
• Schedule and monitor the jobs; do data analysis and real-time integrated data logistics
• Load data using spark submit component and other strategic code, and in different formats depending on the business requirements
• Extract mainframe data, convert it and load into Hadoop
• Defining data retention policies
• Gather and process raw data at scale
• Process unstructured data into a form suitable for analysis
• Develop prototypes and proof of concepts for the selected solutions
• Responsible for coding standards
• Produce technical specifications and architecture that is in accordance to agreed standards
• Increase operational efficiency and suggest solutions to enhance cost effectiveness
• Produce program specifications and implement system enhancements by addressing specific business needs and resolving queries
• Code, compile, test and implement applications in compliance with the Systems Development Life Cycle selecting and integrating any Big Data tools and frameworks required to provide requested capabilities

For more information please contact Tebogo  011 324 7679, alternatively email your updated CV to tebogo@esmartgroup.co.za

If you do not receive a response within 2 weeks please consider your application declined.

Please be advised that we are currently experiencing technical problems receiving emails from Yahoo account, please use an alternative email address when communicating with us. If you do not have alternative address please contact the Recruiter (number above) for an alternative way to submit your application.

Our apologies for the inconvenience caused