Google DeepMind logo

LLM Red Team Specialist

Google DeepMind

Join the LLM Red Team at Google DeepMind

About the Role

Google DeepMind is seeking a creative and skilled LLM Red Team Specialist to join our team in Mountain View, California. This role involves working at the forefront of AI safety and security, focusing on identifying and mitigating risks associated with large language models (LLMs) and other generative models. You will be responsible for discovering and evaluating vulnerabilities in our AI systems, enabling other teams to implement approaches that mitigate these risks.

Key Responsibilities

  • Identify Vulnerabilities: Expose issues in existing and future LLMs and other generative models related to risk areas such as deceptive content, toxicity, bias, plagiarism, weapons development, cyber attacks, and other criminal activities.
  • Develop and Evaluate Attacks: Create and evaluate attacks on LLMs for various threat models, including adversarial attacks, jailbreaks, and prompt injection attacks.
  • Model Analysis: Evaluate models for falsehoods, verbal manipulation, and dangerous scientific capabilities.
  • Collaboration: Work closely with ML and SWE engineering teams to develop vulnerability testing scripts in Python and share insights for internal development.
  • Research and Development: Develop new prompt engineering methods and support the development of scalable tooling in collaboration with other technical staff.
  • Training and Documentation: Create training materials for future red teaming efforts and adversarial analysis.

About You

We are looking for individuals who thrive in ambiguity and are willing to tackle any challenge that moves prototypes forward. Flexibility and adaptability are crucial as we often need to invent novel solutions and change course if ideas don’t work.

Required Skills and Experience

  • Educational Background: BSc/BA, MSc, or PhD/DPhil in computer science, mathematics, applied statistics, machine learning, or similar experience in the industry.
  • Technical Expertise: Proven knowledge and experience with Python and machine learning.
  • Analytical Skills: Ability to conduct analysis of model performance via statistics and data visualization.

Preferred Skills

  • Academic Work: Experience in language models, particularly on adversarial robustness.
  • Security Experience: Previous disclosures of vulnerabilities or security issues in LLMs.
  • ML Frameworks: Experience with TensorFlow, PyTorch, or JAX.
  • Cross-functional Collaboration: Prior experience collaborating with researchers.

Benefits

At Google DeepMind, we offer a range of benefits to support you and your family, including enhanced maternity, paternity, adoption, and shared parental leave, private medical and dental insurance, and flexible working options. We also provide excellent facilities such as healthy food, an on-site gym, and more.

Application Process

If you are passionate about AI safety and security and have the skills and experience we are looking for, we encourage you to apply. Please note that any offer of employment will be conditional on the results of a background check.

Join us in advancing the state of the art in artificial intelligence and ensuring its safe and ethical deployment.

Benefits
Extracted with AI

  • Dental insurance
  • Private medical insurance
  • Flexible working options
  • Enhanced parental leave

Similar jobs

Last update: 23 minutes ago

dataroots logo
dataroots

Expert Machine Learning Engineer

Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.

DeepL logo
DeepL

Senior Backend Engineer C++

Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.

BCG X logo
BCG X

AI Engineer

Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.

Aiven logo
Aiven

Staff Software Engineer

Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.

DwellFi  logo
DwellFi

AI Solutions Software Engineer

Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama. Remote position in Palo Alto, CA.

Together AI logo
Together AI

Senior Backend Engineer - Java, Rust, Go

Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.

Abridge logo
Abridge

Senior Full Stack Engineer, LLM APIs

Join Abridge as a Senior Full Stack Engineer to build innovative ML-powered solutions in healthcare AI, focusing on LLM APIs and cloud services.

Blueprint logo
Blueprint

AI Engineer - Machine Learning and Robotics

Join Blueprint as an AI Engineer in Machine Learning and Robotics, focusing on scalable AI model training systems. Hybrid role in Redmond, WA.

Huawei Nederland logo
Huawei Nederland

Information Retrieval Algorithm Engineer

Join Huawei as an Information Retrieval Algorithm Engineer to develop cutting-edge AI technologies in Amsterdam.

Applied Intuition logo
Applied Intuition

Software Engineer - Autonomous Driving

Join Applied Intuition as a Software Engineer in Munich to tackle autonomous driving challenges with top ADAS/AV programs.

Ilkari logo
Ilkari

Senior Software Engineer - Python, Django, Angular

Join Ilkari as a Senior Software Engineer to lead development in Python, Django, and Angular, creating scalable solutions in a hybrid work environment.

LEGALFLY logo
LEGALFLY

Back End Engineer with Node.js and TypeScript

Join LegalFly as a Back End Engineer to revolutionize legal AI with Node.js and TypeScript in a hybrid role in Ghent.

Redcare Pharmacy logo
Redcare Pharmacy

Senior DevOps Engineer with Linux, Kubernetes, and GCP

Join Redcare Pharmacy as a Senior DevOps Engineer to enhance infrastructure efficiency using Linux, Kubernetes, and GCP.

Zivver logo
Zivver

Front-end Angular Engineer

Join Zivver as a Front-end Angular Engineer to shape the future of secure web applications. Work with Angular, TypeScript, and more in Amsterdam.

micro1 logo
micro1

LLM Engineer with Python and JavaScript

Join us as an LLM Engineer to design and develop scalable software solutions using Python, JavaScript, and AWS in a remote setting.

Attio logo
Attio

Senior Product Engineer [Rust & Typescript]

Join Attio as a Senior Product Engineer working with Rust & TypeScript to build innovative CRM features. Remote work available.

NVIDIA logo
NVIDIA

Machine Learning Engineer - LLM Fine-tuning and Performance

Join NVIDIA as a Machine Learning Engineer specializing in LLM fine-tuning and performance optimization. Work with cutting-edge ML technologies.

Computer Futures logo
Computer Futures

Cloud Data Engineer

Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!

Stream logo
Stream

Python AI Developer Advocate

Join Stream as a Python AI Developer Advocate to build community and enhance AI integrations. Engage with developers and influence product roadmaps.

Ramboll logo
Ramboll

Digital Expert - Software Developer / Full Stack Developer / Data Analyst

Join Ramboll as a Digital Expert in Berlin to drive digital transformation with skills in software development, data analysis, and process automation.

MoonPay logo
MoonPay

Senior Full Stack Engineer - Consumer

Join MoonPay as a Senior Full Stack Engineer in Lisbon, focusing on consumer products using React, TypeScript, and GCP.

Poggio logo
Poggio

Senior AI Engineer

Join Poggio as a Senior AI Engineer to innovate AI systems for enterprise sales, focusing on AI capabilities and system performance.

MoonPay logo
MoonPay

Machine Learning Engineer

Join MoonPay as a Machine Learning Engineer to build and maintain ML infrastructure, collaborating with data scientists and cross-functional teams.

Delivery Hero logo
Delivery Hero

Software Engineer (JavaScript/React) - Display Ads (AdTech)

Join Delivery Hero as a Software Engineer (JavaScript/React) in Berlin to develop cutting-edge AdTech solutions for the local delivery market.