Data Engineer - Messaging Data Platform

Join Twilio as a Data Engineer on the Messaging Data Platform Team

Who We Are & Why We’re Hiring

Twilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences. We are on a journey to becoming a global company that actively opposes racism and all forms of oppression and bias. At Twilio, we support diversity, equity & inclusion wherever we do business.

About The Job

This position is needed to build and maintain highly scalable, reliable, and efficient data pipelines that will empower both inbound and outbound messaging stacks, not to mention other internal engineering solutions, with its data insights interfaces for real-time decision-making.

Responsibilities

In this role, you’ll:

• Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems).
• Design and implement efficient data pipelines for the acquisition, storage, and analysis of large datasets.
• Collaborate with cross-functional teams to understand data requirements and implement solutions.
• Ensure the availability and integrity of data pipelines and systems.
• Optimize and fine-tune performance of data solutions.
• Troubleshoot and resolve data-related issues in a timely manner.
• Develop and maintain documentation for data processes and pipelines.
• Stay abreast of emerging technologies and industry trends related to data engineering.
• Create tools that make it easy for non-technical users to easily, and reliably, transform and query data.

Qualifications

Required

• 3+ years of Java development experience.
• 3+ years of experience with Big Data processing tools and frameworks such as Apache Spark, SparkSQL.
• Experience with Lakehouse technologies, such as Apache Hudi, Apache Iceberg, Databricks Delta Lake.
• Deep technical understanding of ETL tools, low-latency data stores, multiple data warehouses and data catalogs.
• Familiarity with data testing and verification tooling and best practices.
• Experience with cloud services (AWS preferred, Google, Azure etc.)
• Readiness to participate in the on-call rotation.

Desired

• Proficient in working with Key-Value, Streaming, and Search Database technologies, including AWS DynamoDB, Apache Kafka, and ElasticSearch.
• Experience in building AI/ML pipelines.
• Demonstrated technical breadth and depth as evidenced by papers, code, and/or presentations.
• Exposure to service-oriented architectures, microservices and REST APIs.
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Bachelor's degree in Computer Science, Engineering or a related field, or equivalent training, fellowship, or work experience.

Location

This role will be based in Dublin or remotely in Ireland.

Travel

For this role, you may be required to travel occasionally to participate in project or team in-person meetings.

What We Offer

There are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Twilio thinks big. Do you?

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values — something we call Twilio Magic. Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now!