Python Data Engineer

Python Data Engineer

London, UK
Salary: £Competitive

The Role

We appreciate the value of data within ours and client’s business. We generate more data than ever before but we recognise that clean and meaningful data streamed at a rate which can give us a competitive edge is the key. Our Data Engineers are key to activating our innovative solutions. The role requires an individual who can work with other engineers and analysts to create solutions which integrate with our advertising technology stack. The role will be partially client facing, with the collation and documentation of requirements.

 

We would expect the individual to achieve the Certified Google Data Engineer status shortly after joining (if this is not already attained) and maintain this qualification. Training will be provided where necessary.

 

We also run GCP Training Courses and it would be expected that the individual would take part in giving those courses to our clients (after attaining the GCP Trainer accreditation).

Responsibilities

  • Responsible for all extract, transform and load (ETL) processes and the creation of applications that can connect to remote APIs. Preferably including DoubleClick, Google Analytics, AdWords and Google Tag-Manager and stream data into environments such as BigQuery.

  • Responsible for the management of multiple processes and applications, performance reporting and error checking.

  • Responsible for the management of all data created within client applications, the structure of data held and the views of data created.

  • Responsible for recommending the correct technologies to be used and in the most cost effective manner.

  • Responsible for the design and creation of data led strategies which provide clients with opportunities to leverage their data for greater insight or performance.

  • Provide thought leadership with regards to best practice and use of the google cloud platform.

Experience Required

  • Solid Python programming skills. Java / other languages beneficial.

  • Strong SQL experience, any flavour.

  • Must have experience of building robust pipelines and data environments to support database or machine learning based applications.

  • Google Cloud Platform experience is beneficial

  • Official Google Data Engineer Certification is beneficial.

  • Data Engineering / BI Development / Data Warehousing experience.

  • Knowledge of serverless infrastructure beneficial

 

  • Ability to scope a project based on a technical brief and work with the DevOps and QA teams to provide a detailed project plan including:
    • Data Flow Diagrams for process flow
    • Database Schemas & Normalisation
    • Recommended software / plugins / architecture
    • Scalable environment architecture suggestions
    • Hosting, storage, load balancing and caching suggestions
    • Performance considerations
    • Security considerations
    • Assumptions & Exclusions
    • A complete and accurate estimate for the project

  • Ability to assess new business and respond with a full list of targeted questions to ensure accurate estimates are created

 

  • Ability to research solutions to technical problems

  • Experience scheduling/automating scripts

  • Experience with streaming data beneficial

  • Experience on Linux command line and Bash scripting

  • Experience with Git/GitHub

  • Experience with Dataflow, Google PubSub or other queuing software beneficial

  • Good experience of parsing data formats such as XML/JSON and using 3rd party API’s
    • Experience with Curl / Postman /  similar beneficial

  • Experience in using data storage solutions such as DocumentDB, BigTable,  NoSQL, MongoDB, Hadoop

  • Basic experience with Tensorflow. CloudML, Spark, SparkML Beneficial

 

  • An understanding of how data can benefit the wider business, and how to translate technical requirements to non-technical stakeholders.

Key Attributes

  • A self-motivated individual with high levels of energy.

  • An outgoing, curious thinker, with consistent levels of evident enthusiasm.

  • Flexible, versatile and copes well under pressure.

  • Open, honest and direct, is comfortable in giving and receiving constructive feedback.

  • Has high personal standards and promotes them in others.

  • A valued team member, who upholds Jellyfish’s values and professional integrity at all times.

  • Strong verbal and communication skills – able to communicate with clients effectively

  • Pro-active & self-motivated with a sense of ownership

  • Adopts a “leave code better than you found it (and fully commented)” attitude
Contact
Please enter a valid Name.
Please enter a valid email address.
Please enter a valid Phone.
Please enter a valid Company Name.
  • Select Service
  • Analytics
  • Brand
  • Consultancy
  • Conversion Rate Optimization
  • Display
  • DoubleClick Partnership
  • Email
  • PPC
  • SEO
  • Social
  • UX
  • Video
  • Websites
  • All Services
By providing your email address you are allowing Jellyfish to send you email communications in accordance with our Privacy Policy and Terms and Conditions