Senior Data Engineer

About Unbabel

Unbabel eliminates language barriers so that businesses can thrive across cultures and geographies. The company’s language operations platform blends advanced artificial intelligence with human editors, for fast, efficient, high-quality translations that get smarter over time. Unbabel integrates seamlessly in any channel, so agents can deliver consistent multilingual support from within their existing workflows. Making it easy for enterprises to grow into new markets and build customer trust in every corner of the world.

What's the Opportunity?

Unbabel’s data is large and complex and having it accessible to different stakeholders is no simple task. Our main goal is to make sure everybody in Unbabel has access to the data they need, in the way they need it.

As a Senior Data Engineer, you will play a crucial role in designing, building and maintaining our distributed data platform. You will collaborate closely with cross-functional teams to develop scalable, reliable, and high-performance data solutions for operational and analytical use cases, that empower our organization to extract meaningful insights from diverse data sources within a data mesh architecture. Examples of the work you will be involved in includes implementation and improvements in event-driven architecture for data processing, and data stores that feed and improve our AI systems/models.

Responsibilities

• Design, implement and optimize operational and analytical data pipelines to ingest, process, and transform data from various sources, ensuring scalability, reliability, and efficiency.
• Design batch or streaming dataflows capable of processing large quantities of fast moving unstructured data.
• Collaborate with domain-oriented teams to understand their data requirements and provide guidance on data integration, access, and consumption within a data mesh architecture.
• Design and implement the data platform tools used across the organization.
• Establish and enforce data governance policies, including metadata management, access control, and compliance with regulatory requirements, to ensure the security and integrity of our data assets.
• Monitor dataflows and underlying systems, promoting the necessary changes to ensure scalable, high performance solutions and assure data quality and availability.
• Work closely with AI, Engineering and the rest of Unbabel to deliver world class data driven solutions.

Requirements

• BS/MS Degree in Computer Engineering, Computer Science or a similar area.
• Minimum of 4 years of experience in Data Engineering.
• Software engineering background with experience in OO programming or Functional Programming.
• We work mostly in Python but you should at least have experience with one of the following: Java, Scala or Python.
• Strong system design and data architecture design skills.
• Good understanding of distributed systems principles.
• Familiarity with data modeling concepts and techniques.
• Experience with NoSQL databases, such as MongoDB, Cassandra, and HBase.
• Experience with messaging systems, such as Kafka or RabbitMQ.
• Experience with AWS, especially the data services in AWS.
• Strong SQL knowledge.
• Strong analytical and problem-solving skills, with the ability to troubleshoot and optimize complex data workflows and infrastructure.
• Strong written and verbal English communication skills.

Nice to Have

• Experience with Data Warehouses (e.g. Redshift, Snowflake, etc.), Data Lakes and related concepts.
• Good understanding of Lambda and Kappa Architectures, along with their advantages and drawbacks.
• Knowledge stream-processing systems, using solutions such as Spark-Streaming, Flink, Kafka Streams, Storm or similar.
• Experience with other cloud providers e.g. GCP or Azure Cloud.
• Experience with Data quality and Data lineage tools.
• Experience with Looker.

Diversity Statement

Unbabel is an Equal Opportunity Employer. We do not discriminate based on ethnicity, religion, color, sex, gender identity, sexual orientation, age, or mental disability. Not only do we not discriminate, but we celebrate differences. If for whatever reason you need us to make reasonable adjustments and adaptations to our recruitment process, please let your recruiter know.