About The Team
OpenAI's Human Data Team creates custom data solutions driving groundbreaking research. Our work enhances and evaluates our flagship models and products like ChatGPT, GPT-4, and Sora, and contributes to safety initiatives through collaboration with our Preparedness and Safety Systems teams.
We work with AI trainers to gather specialized data for training and evaluating our models across modalities such as video, audio, text, and tool actions. Our goal is to develop scalable methods, tools, and platforms to generate and evaluate high-quality data from both synthetic sources and human experts in various fields, including mathematics, sciences, creative writing, programming, art, and safety. We leverage OpenAI models to improve and streamline our data collection and quality processes.
About The Role
In this role, you will work side by side with research teams to iteratively design and evaluate new methods for collecting high quality human data. You’ll use your knowledge of human cognition and data quality to co-design experiments, write instructions and assess the efficacy of our data collections. In parallel, you’ll partner with engineering and operations to implement changes and iteratively improve how we run human data campaigns.
This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
Responsibilities
- Collaborate closely with researchers to understand, predict, and design tasks and quality rubrics to collect great human data.
- Engage with data labelers and vendors to evolve training and feedback mechanisms.
- Create hiring assessments and brainstorm acquisition strategies for high skill data labelers.
- Design and conduct experiments to assess the impact of interventions on human data quality.
- Come up with creative strategies for collecting and assessing high-quality data.
- Generate golden datasets and evaluation techniques.
- Work on multiple projects with tight timelines.
- Do whatever needs to be done to make our models better.
You Might Thrive In This Role If You
- Have a background in cognitive science, computational linguistics, human-computer interaction.
- Enjoy tackling big questions in an ambiguous and fast-paced environment.
- Love being at the intersection of research and operational execution.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.
Benefits Extracted with AI
- Relocation assistance
- Hybrid work model
Similar jobs
Last update: 23 minutes ago
Senior ASR / TTS Researcher
Join Huawei's research center in Amsterdam as a Senior ASR/TTS Researcher, focusing on speech synthesis and AI.
AI Engineer
Join BCG X as an AI Engineer in Milan, Italy. Develop AI solutions, partner with clients, and drive innovation in a dynamic environment.
Principal AI Engineer
Join Cere Network as a Principal AI Engineer to drive AI innovation in Web3. Requires 10+ years in AI/ML, NLP, and software development.
Senior Backend Engineer - Java, Rust, Go
Join Together AI as a Senior Backend Engineer in Amsterdam. Work with Java, Rust, and Go to build scalable backend systems.
Information Retrieval Algorithm Engineer
Join Huawei as an Information Retrieval Algorithm Engineer to develop cutting-edge AI technologies in Amsterdam.
Expert Machine Learning Engineer
Join Dataroots as an Expert Machine Learning Engineer to design and deliver AI-powered solutions, focusing on machine learning models.
Staff Software Engineer
Join Aiven as a Staff Software Engineer to develop cloud operations platforms using open-source technologies. Hybrid work in Berlin.
AI Solutions Software Engineer
Join DwellFi as an AI Solutions Software Engineer to develop innovative AI solutions using LangChain or Llama. Remote position in Palo Alto, CA.
AI Engineer - Machine Learning and Robotics
Join Blueprint as an AI Engineer in Machine Learning and Robotics, focusing on scalable AI model training systems. Hybrid role in Redmond, WA.
Senior Backend Engineer C++
Join DeepL as a Senior Backend Engineer C++ to design and maintain scalable backend services using C++ and AI technologies.
Senior Software Engineer (C++)
Join Nebius as a Senior Software Engineer (C++) to develop reliable cloud services in a hybrid work environment.
Product AI Engineer
Join xAI as a Product AI Engineer to develop cutting-edge AI consumer products using ML, Python, and Rust in Palo Alto, CA.
Software Engineer - Autonomous Driving
Join Applied Intuition as a Software Engineer in Munich to tackle autonomous driving challenges with top ADAS/AV programs.
Senior AI Engineer
Join Poggio as a Senior AI Engineer to innovate AI systems for enterprise sales, focusing on AI capabilities and system performance.
Python AI Developer Advocate
Join Stream as a Python AI Developer Advocate to build community and enhance AI integrations. Engage with developers and influence product roadmaps.
Frontend Engineer, AI
Join Aleph as a Frontend Engineer focusing on AI to develop innovative features using React.js and AI technologies in a remote role.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Full Stack Software Engineer, Autonomous Agents
Join xAI as a Full Stack Software Engineer to build innovative AI systems using TypeScript, Python, and more in a hybrid role in Palo Alto.
AI Software Engineer
Join Zoom as an AI Software Engineer to design and optimize AI algorithms and applications. Work remotely with a focus on AI infrastructure.
Machine Learning Scientist
Join Arena as a Machine Learning Scientist to develop AI systems using PyTorch and TensorFlow, focusing on real-world problem-solving.
Senior Backend Engineer (Go)
Join Nebius as a Senior Backend Engineer (Go) to develop fault-tolerant cloud services in a hybrid work environment.
Senior Software Engineer - Python, Apache Kafka
Join Aiven as a Senior Software Engineer in Berlin, focusing on Python and Apache Kafka in a hybrid work environment.
Senior Fullstack & Unity Developer (Gen AI, AR)
Join ZAUBAR as a Senior Fullstack & Unity Developer in Berlin to create immersive AR experiences with GenAI. Work on cutting-edge technology in a dynamic team.
AI Engineer & Researcher - Data / Crawling
Join xAI as an AI Engineer & Researcher to build data processing systems and manage cloud workloads.
