Research Engineer

At Canva our mission is to empower the world to design. To ensure our generative AI models are truly helpful we are seeking a talented data focused Research Engineer to build our next-generation design and vision models.About the role:In this foundational role you will be the expert on what fuels our models: data. You will be responsible for the end-to-end lifecycle of our datasets from curating nuanced human feedback on design quality to pioneering the use of machine learning for high-quality synthetic data generation. You will design the sophisticated human evaluation studies and experiments that measure our success and you will be the key analyst who translates signals from automated evaluators into a deep understanding of our models alignment with human taste and intent. This is a unique role for a data-first thinker with a strong design sensibility who is passionate about building the ground truth that will define the future of creativity.At the moment this role is focused on:Human Feedback Data Curation: Owning the processing cleaning and strategic curation of large-scale subjective human feedback on design quality which is the lifeblood of our models.Synthetic Data Generation: Using generative AI and machine learning techniques to create novel high-quality synthetic data that augments our training sets and improves model capabilities.Alignment Analysis & Evaluation Design: Designing methods to analyze outputs from both human and automated systems to deeply understand and measure our models alignment with user preferences.Primary Responsibilities:Design and build scalable pipelines for processing and curating large datasets of human design feedback.Develop ML models to generate high-quality synthetic data for training and fine-tuning.Own the design and implementation of human evaluation workflows including creating guidelines and quality rubrics.Prepare datasets for automated evaluation systems and analyze their outputs to provide a robust signal on model performance and human alignment.Design and analyze experiments (including A/B tests) to measure the real-world impact of our models on design quality.Conduct deep-dive analyses into model performance to identify failure modes and guide future development.Youre probably a match if you have:A strong aesthetic sense with a background or demonstrated passion for visual design or human-computer interaction.Strong proficiency in Python and ML frameworks (e.g. PyTorch TensorFlow).Solid understanding of statistical methods including experimental design A/B testing and quality evaluation systems.Experience with generative AI and synthetic data generation is highly desirable.Familiarity with data annotation tools is a plus.Additional Information : Whats in it for youAchieving our crazy big goals motivates us to work hard - and we do - but youll experience lots of moments of magic connectivity and fun woven throughout life at Canva too. We also offer a stack of benefits to set you up for every success in and outside of work.Heres a taste of whats on offer:Equity packages - we want our success to be yours tooInclusive parental leave policy that supports all parents & carersAn annual Vibe & Thrive allowance to support your wellbeing social connection home office setup & moreFlexible leave options that empower you to be a force for good take time to recharge and supports you personallyCheck out for more info.Other stuff to knowWe make hiring decisions based on your experience skills and passion as well as how you can enhance Canva and our culture. When you apply please tell us the pronouns you use and any reasonable adjustments you may need during the interview process.Please note that interviews are predominantly conducted virtually. Remote Work : YesEmployment Type : Full-time Key Skills Robotics,Machine Learning,Python,AI,C/C++,OS Kernels,Research Experience,Matlab,Rust,Research & Development,Natural Language Processing,Tensorflow Experience: years Vacancy: 1