Automation Engineer

2 months ago

City of London, United Kingdom Undisclosed Company Full time

Automation Engineer

Remote

6 months

Inside ir35

Role description

We are looking for an experienced Automation Engineer with a strong focus on application/platform profiling and performance optimization in an enterprise environment. The ideal candidate will have extensive knowledge of automation tools, especially Chef InSpec, and be proficient in profiling various types of applications, including those based on Hadoop. Additionally, they will need a deep understanding of monitoring tools such as Grafana and Prometheus, particularly in working with Prometheus data formats and creating performance dashboards.

The candidate will be responsible for automating application performance profiling, optimizing configurations, and setting up comprehensive monitoring solutions. Experience with profiling distributed applications like Hadoop will be essential. Furthermore, the engineer will collaborate closely with the operations, development, and DevOps teams to ensure that automated processes are in place for effective performance monitoring and compliance testing.

Key Responsibilities:

  • Application Profiling:
    • Perform detailed profiling of various applications, including distributed systems like Hadoop, identifying performance bottlenecks and optimization opportunities.
  • Automation Implementation:
    • Develop and maintain automation scripts and configurations, particularly using Chef InSpec, to automate application profiling, compliance checks, and infrastructure audits.
  • Performance Monitoring:
    • Configure and manage monitoring systems, particularly Grafana and Prometheus, to track application performance and generate real-time insights.
  • Hadoop Profiling:
    • Utilize profiling tools and techniques specific to Hadoop to analyze job performance, resource utilization, and system health.
  • Data Format Expertise:
    • Work with Prometheus data formats to build efficient monitoring and alerting solutions integrated with Grafana dashboards.
  • Automation for PerformanceOptimization:
    • Create and manage automation processes for continuous application performance tuning, resource allocation, and compliance validation.
  • System Integration:
    • Collaborate with other teams to integrate application profiling and monitoring solutions into broader enterprise architectures, ensuring automation processes are in place for scalability and reliability.
Skill Set:Technical Skills:
  • Automation Tools:
    • Proficiency with Chef InSpec for automation and compliance testing.
    • Strong scripting skills in Python, Bash, or Ruby for automation tasks.
    • Experience automating infrastructure tasks, especially around application performance.
  • Application Profiling:
    • Expertise in application performance profiling tools (e.g., Apache JProfiler, YourKit, VisualVM) to analyze resource consumption, thread behavior, and response times.
    • Hands-on experience with profiling Hadoop applications, understanding resource allocation, job execution, and data flow optimization within distributed environments.
  • Monitoring & Logging Tools:
    • Grafana for visualizing performance metrics and setting up application monitoring dashboards.
    • Prometheus for collecting, querying, and alerting on performance data.
    • Understanding of Prometheus data formats and the ability to set up custom metrics for application monitoring.
  • DevOps & Automation Processes:
    • Experience with CI/CD pipelines using Jenkins or similar tools for automating the deployment and profiling of applications.
    • Familiarity with infrastructure as code and automation methodologies.
  • Performance Monitoring &Optimization:
    • Experience setting up performance dashboards and monitoring solutions.
    • Strong understanding of resource optimization, bottleneck analysis, and system tuning for enterprise-scale applications.
  • Hadoop Ecosystem:
    • Strong understanding of the Hadoop ecosystem (HDFS, MapReduce, YARN, Hive) and the ability to profile and optimize resource usage within distributed systems.
    • Familiarity with Apache Spark and Hadoop performance tuning is a plus.
Tools & Technologies:Automation & Profiling:
  • Chef InSpec (for automation and compliance testing)
  • Scripting: Python, Bash, Ruby
  • Application Profiling Tools: Apache JProfiler, YourKit, VisualVM or equivalent tools for Java-based applications
  • Hadoop-specific tools: Hadoop Profiler, Ganglia, Ambari Metrics
Monitoring & Data Visualization:
  • Grafana (for setting up performance dashboards and real-time monitoring)
  • Prometheus (for collecting and querying performance data)
  • Prometheus data formats (for custom metrics creation)
Application & System Monitoring:
  • Hadoop monitoring (using tools like Ambari, Ganglia)
  • Elasticsearch, Loki (for logs management and application performance insights)
DevOps Tools:
  • Jenkins (for CI/CD pipeline automation)
  • Git (for version control and automation)
Qualifications:
  • Experience: 5+ years in automation, application profiling, or DevOps roles, with specific experience working with Hadoop and application performance monitoring.
  • Certifications(if any):
    • Chef Certified Engineer or equivalent certification in automation tools is preferred.
    • Hadoop Certifications (Cloudera Certified Administrator or Developer) are a bonus.

Education: Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience

  • Automation Engineer

    1 month ago

    London, Greater London, United Kingdom Software Defined Automation GmbH Full time

    About the PositionWe are seeking a talented QA Automation Engineer to join our team at Software Defined Automation GmbH. As a key member of our team, you will be responsible for building automated testing solutions that engage millions of sports fans worldwide.Tech Stack:JavaScriptAPIGitPostmanCypressPlease mention you found this job on TestDev Jobs. It...

  • Automation Engineer

    1 month ago

    London, Greater London, United Kingdom Software Defined Automation GmbH Full time

    About the PositionWe are seeking a talented QA Automation Engineer to join our team at Software Defined Automation GmbH. As a key member of our team, you will be responsible for building automated testing solutions that engage millions of sports fans worldwide.Tech Stack:JavaScriptAPIGitPostmanCypressPlease mention you found this job on TestDev Jobs. It...

  • Automation Engineer

    2 months ago

    London, Greater London, United Kingdom Software Defined Automation GmbH Full time

    This Job was posted more than 60 days ago and might have expired. We recommend exploring more recent job opportunities.About the PositionAre you passionate about building automated testing solutions that engage millions of sports fans worldwide? At Software Defined Automation GmbH, we're looking for a talented QA Automation Engineer to join our team and help...

  • Automation Engineer

    2 months ago

    London, Greater London, United Kingdom Software Defined Automation GmbH Full time

    This Job was posted more than 60 days ago and might have expired. We recommend exploring more recent job opportunities.About the PositionAre you passionate about building automated testing solutions that engage millions of sports fans worldwide? At Software Defined Automation GmbH, we're looking for a talented QA Automation Engineer to join our team and help...

  • Automation Engineer

    2 weeks ago

    London, Greater London, United Kingdom Software Defined Automation GmbH Full time

    About the PositionWe are seeking a talented QA Automation Engineer to join our team at Software Defined Automation GmbH. As a key member of our team, you will be responsible for building automated testing solutions that engage millions of sports fans worldwide.Key Responsibilities:Design and develop automated testing solutions using JavaScript, API, Git, and...

  • Automation Engineer

    2 weeks ago

    London, Greater London, United Kingdom Software Defined Automation GmbH Full time

    About the PositionWe are seeking a talented QA Automation Engineer to join our team at Software Defined Automation GmbH. As a key member of our team, you will be responsible for building automated testing solutions that engage millions of sports fans worldwide.Key Responsibilities:Design and develop automated testing solutions using JavaScript, API, Git, and...

  • Senior Quality Assurance Automation Engineer

    1 week ago

    London, Greater London, United Kingdom Mimica Automation Full time

    About the RoleMimica Automation is seeking a highly skilled Quality Assurance Automation Engineer to join our team. As a key player in defining our testing culture, you will be responsible for transforming our release cycle by enabling us to ship code reliably and faster.You will own the end-to-end QA process for the Mimica Web App and work alongside...

  • Automation Engineer

    1 month ago

    City Of London, United Kingdom Experis - ManpowerGroup Full time

    Job Title: Automation EngineerWe are seeking an experienced Automation Engineer to join our team at Experis - ManpowerGroup. As an Automation Engineer, you will be responsible for automating application performance profiling, optimizing configurations, and setting up comprehensive monitoring solutions.Key Responsibilities:Application Profiling: Perform...

  • Automation Engineer

    1 month ago

    City Of London, United Kingdom Experis - ManpowerGroup Full time

    Job Title: Automation EngineerWe are seeking an experienced Automation Engineer to join our team at Experis - ManpowerGroup. As an Automation Engineer, you will be responsible for automating application performance profiling, optimizing configurations, and setting up comprehensive monitoring solutions.Key Responsibilities:Application Profiling: Perform...

  • Senior Quality Assurance Automation Engineer

    1 week ago

    London, Greater London, United Kingdom Mimica Automation Full time

    About the RoleMimica Automation is seeking a highly skilled Quality Engineering Lead - Automation to join our team. As a key player in defining our testing culture and transforming our release cycle, you will be responsible for owning the end-to-end QA process for the Mimica Recorder and working alongside developers to add tests, modify app code, and expand...

  • Automation Engineer

    1 month ago

    City Of London, United Kingdom Experis - ManpowerGroup Full time

    Job Title: Automation EngineerWe are seeking an experienced Automation Engineer to join our team at Experis - ManpowerGroup. As an Automation Engineer, you will be responsible for automating application performance profiling, optimizing configurations, and setting up comprehensive monitoring solutions.Key Responsibilities:Application Profiling: Perform...

  • Automation Engineer

    1 month ago

    City Of London, United Kingdom Experis - ManpowerGroup Full time

    Job Title: Automation EngineerWe are seeking an experienced Automation Engineer to join our team at Experis - ManpowerGroup. As an Automation Engineer, you will be responsible for automating application performance profiling, optimizing configurations, and setting up comprehensive monitoring solutions.Key Responsibilities:Application Profiling: Perform...

  • Automation Engineer/QA Automation Specialist

    2 weeks ago

    London, Greater London, United Kingdom Software Defined Automation GmbH Full time

    About the PositionWe're seeking a talented QA Automation Engineer to join our team at Software Defined Automation GmbH. As a key member of our team, you'll play a crucial role in building automated testing solutions that engage millions of sports fans worldwide.Key Responsibilities:Design and develop automated testing solutions for web and native...

  • Project Sales Engineer

    4 weeks ago

    City of London, United Kingdom Mojo Automation Ltd Full time

    Project Sales EngineerMojo Automation Ltd is seeking a highly skilled Project Sales Engineer to join our team. As a Project Sales Engineer, you will be responsible for selling our Connection Technology, Electrical Installation solutions, and Interface Technology systems and products to leading international manufacturers.Key Responsibilities:Selling our...

  • Automation Quality Assurance Lead

    3 days ago

    London, Greater London, United Kingdom Mimica Automation Full time

    We are seeking a skilled Automation Quality Assurance Lead to join our team at Mimica Automation.About the RoleThis is a unique opportunity to shape our testing culture and transform our release cycle to enable reliable and faster code shipping.You will own the end-to-end QA process for the Mimica Recorder and work alongside developers to add tests, modify...

  • Windows Automation Engineer

    1 month ago

    City of London, United Kingdom CV-Library Full time

    Windows Automation Engineer Full Time Permanent Remote WFH (London office twice per month) £70-90K basic + benefits Are you an experienced Windows Automation Engineer looking for a new challenge? Do you have a strong background in Windows Automation, Windows System Administration & cloud platforms along with Ansible, Git, CI/CD pipelines,...

  • Windows Automation Engineer

    4 weeks ago

    City of London, United Kingdom CV-Library Full time

    Windows Automation Engineer Full Time Permanent Remote WFH (London office twice per month) £70-90K basic + benefits Are you an experienced Windows Automation Engineer looking for a new challenge? Do you have a strong background in Windows Automation, Windows System/Server Administration & cloud platforms along with Ansible, Git, CI/CD pipelines,...

  • Automation Test Engineer

    3 weeks ago

    City of London, United Kingdom ANSON MCCADE Full time

    Job DescriptionANSON MCCADE is seeking a highly skilled QA Automation Engineer to join our team.Key Responsibilities:Design and implement automated testing frameworks for API contracts using RESTCollaborate with cross-functional teams to identify and prioritize testing requirementsDevelop and maintain test automation scripts using Cypress, Docker, and...

  • Automation Test Engineer

    3 weeks ago

    City of London, United Kingdom ANSON MCCADE Full time

    Job DescriptionANSON MCCADE is seeking a highly skilled QA Automation Engineer to join our team.Key Responsibilities:Design and implement automated testing frameworks for API contracts using RESTCollaborate with cross-functional teams to identify and prioritize testing requirementsDevelop and maintain test automation scripts using Cypress, Docker, and...

  • Electrical Design Engineer

    2 weeks ago

    London, Greater London, United Kingdom Automation Experts Ltd Full time

    Automation Experts Ltd is seeking a highly skilled Senior Electrical Design Engineer to join their team in Manchester. The ideal candidate will have a strong background in electrical design, with experience in managing panel building departments and integrating machinery with robot automation solutions.Key Responsibilities:Design and develop electrical...