This Is A Custom Widget

This Sliding Bar can be switched on or off in theme options, and can take any widget you throw at it or even fill it with your custom HTML Code. Its perfect for grabbing the attention of your viewers. Choose between 1, 2, 3 or 4 columns, set the background color, widget divider color, activate transparency, a top border or fully disable it on desktop and mobile.

This Is A Custom Widget

This Sliding Bar can be switched on or off in theme options, and can take any widget you throw at it or even fill it with your custom HTML Code. Its perfect for grabbing the attention of your viewers. Choose between 1, 2, 3 or 4 columns, set the background color, widget divider color, activate transparency, a top border or fully disable it on desktop and mobile.

This Is A Custom Widget

This Sliding Bar can be switched on or off in theme options, and can take any widget you throw at it or even fill it with your custom HTML Code. Its perfect for grabbing the attention of your viewers. Choose between 1, 2, 3 or 4 columns, set the background color, widget divider color, activate transparency, a top border or fully disable it on desktop and mobile.

This Is A Custom Widget

This Sliding Bar can be switched on or off in theme options, and can take any widget you throw at it or even fill it with your custom HTML Code. Its perfect for grabbing the attention of your viewers. Choose between 1, 2, 3 or 4 columns, set the background color, widget divider color, activate transparency, a top border or fully disable it on desktop and mobile.

Big Data Engineer – Python – Hadoop – Spark – Scala

clear search

Big Data Engineer – Python – Hadoop – Spark – Scala

September 11, 2018
You will have proven experience in Big Data Engineering.

Working proficiency in Big Data development toolset to design, develop, test, deploy, maintain and improve software.

Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test Driven Development, Cloud Development, application resiliency and security.

Job Description:
  • Create software components (using Python, SQL and Big Data tech i.e. Hadoop – Spark)
    Integrate data from a variety of data sources utilising on-prem or cloud-based data structures (AWS)
  • Determine new and existing data sources
  • Develop, implement and optimize streaming, data lake, and analytics big data solutions
  • Create and execute testing strategies including unit, integration, and full end-to-end tests of data pipelines
  • Utilise ETL processes to build data repositories; integrate data into Hadoop data lake
  • Work directly with data scientists as well as business teams to meet both functional and technical requirements
  • Work with devops teams to deploy and integrate software solutions

Required Skills:
  • 5+ years’ experience developing software solutions in Python
  • Experience developing in Java/ Scala, or other functional languages 
  • Strong computer science skills (data structures, algorithms)
  • Strong experience with data modelling and modern databases (SQL, Oracle, PL/SQL)
  • Experience with the Hadoop – Spark technology stack is a strong plus

Please understand due to number of applications only suitable candidates will be contacted.
  • Job Categories: IT & Telecomms ( Software – Developer )
  • Job Types: Permanent / Full Time
  • Job Location: Sydney

CLICK HERE TO APPLY FOR THIS JOB

Sabrina Matuda

IT Recruitment Consultant
  • author
  • author

I am a real people person and spent over a decade in language studies, coaching and sales. I have a Bachelor’s degree in Languages and Literature, a Master's degree in English and a PhD in Translation studies (#nerd). However, a serendipitous event got me into IT recruitment. And I’m loving it! Why? Recruiting has allowed me to leverage my passion for building and maintaining rewarding relationships with my clients while remaining challenged to find the perfect candidates and, in my case, it has also allowed me to keep updated with all the technology trends out there. I take pride in ensuring that placements are a strong match for both parties. There’s nothing more exciting than helping smart people find their next challenge. If I’m not working, I’m probably learning a new language, enjoying a glass of nice champagne or traveling. If you are looking at hiring or contemplating your next career move in IT hit me up on sabrina@citirecruitment.com. Also, I love meeting new people and learning new things, so feel free to connect and share your experience. :)

Subscribe to our IT Jobs & News Alerts

Meet the CITI Team


  • Sabrina Matuda

    IT Recruitment Consultant
  • Stephen Revins

    Java Recruitment Consultant

IT & Digital Recruitment Without Guesswork

"Our strength lies in understanding the complete client environment, which includes not only the technology but also the mindset of the individuals working in IT environments. We provide a hiring solution that serves both the needs of its clients and candidates. We provide a premium IT talent management service supported by well thought out business processes and operating methodologies." - Steve Wilson, Founder CITI Recruitment

  • Sabrina Matuda

    I am a real people person and spent over a decade in language studies, coaching and sales. I have a Bachelor’s degree in Languages and Literature, a Master's degree in English and a PhD in Translation studies (#nerd). However, a serendipitous event got me into IT recruitment. And I’m loving it! Why? Recruiting has allowed me to leverage my passion for building and maintaining rewarding relationships with my clients while remaining challenged to find the perfect candidates and, in my case, it has also allowed me to keep updated with all the technology trends out there. I take pride in ensuring that placements are a strong match for both parties. There’s nothing more exciting than helping smart people find their next challenge. If I’m not working, I’m probably learning a new language, enjoying a glass of nice champagne or traveling. If you are looking at hiring or contemplating your next career move in IT hit me up on sabrina@citirecruitment.com. Also, I love meeting new people and learning new things, so feel free to connect and share your experience. :)

    Sabrina Matuda
  • Stephen Revins

    I’ve successfully built up 5 years of local industry knowledge specialising in emerging technologies. I have a strong JAVA and Ruby on Rails following in NSW and VIC. I also have extensive experience sourcing specialist software development teams for technology companies with highly transactional, high volume, data intensive environments. Please contact me for more info - steve.revins@citirecruitment.com

    Stephen Revins

What Others Say

"CITI Recruitment is a rarity in the recruitment industry."

“CITI Recruitment is a rarity in the recruitment industry. They are honest, open and reliable. Their knowledge of the IT market is impressive, and their understanding of complex web content management requirements is exemplary. I have worked with CITI for over a 2 years and look forward to working with them again” - Owen B, Sitecore.

  • CITI Recruitment is a great recruiter. They are inventive, and persistent in their search – and ha...

    Clive Roberts, Proquest Consulting

  • “CITI Recruitment is a rarity in the recruitment industry. They are honest, open and reliable. The...

    Owen B, Sitecore

  • We have been very impressed with CITI Recruitment and will be using them for any future hiring needs...

    Spendvision, www.spendvision.com

  • “CITI Recruitment is a rarity in the recruitment industry. They are honest, open and reliable. The...

    Open Text Web Solutions Group, www.opentext.com

  • What I really appreciate about CITI Recruitment is theirs dilligent and professional approach to wor...

    Gindalbie Metals, www.gindalbie.com.au

  • CITI Recruitment contacted me through LinkedIn earlier this year to talk me through a new and exciti...

    Yvette Fillery, www.linkedin.com/in/yvettefillery

  • We have been very impressed with CITI Recruitment and will be using them for any future hiring needs...

    Spendvision, www.spendvision.com

LOOKING FOR INSPIRATION?