Job Overview
We are seeking a skilled AI/ML Data Engineer to join our dynamic team in Baltimore, Maryland. As a Data Engineer, you will be responsible for developing and maintaining data pipelines and ETL processes, ensuring the smooth delivery and availability of data for our data scientists and analysts. You will work with cutting-edge technologies and cloud platforms to design scalable data processing solutions.
Key Responsibilities
- Develop and Maintain Data Pipelines: Utilize Python, Pandas, and Apache Spark to create efficient data pipelines and ETL processes.
- Design Scalable Solutions: Implement scalable data processing solutions on cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Collaborate with Teams: Work closely with data scientists and analysts to understand data requirements and ensure data integrity and quality.
- Data Cleaning and Transformation: Perform data cleaning, transformation, and normalization tasks to maintain data quality.
- Optimize Workflows: Enhance data workflows and infrastructure for improved performance and efficiency.
- Implement Data Governance: Apply data governance and security best practices to protect sensitive information.
- Identify Improvement Opportunities: Proactively seek opportunities for data quality improvements and implement effective solutions.
Required Skills and Qualifications
- Proficiency in Python: Strong emphasis on data manipulation using Pandas.
- Experience with Apache Spark: Knowledge of large-scale data processing and distributed computing.
- Cloud Computing Expertise: Hands-on experience with AWS, Azure, or GCP, including services like S3, EC2, EMR, and Databricks.
- Data Cleaning and Transformation: Solid understanding of data cleaning, formatting, and transformation techniques.
- Database Knowledge: Familiarity with SQL and NoSQL databases for data storage and retrieval.
- Problem-Solving Skills: Excellent problem-solving abilities and the capacity to work independently or as part of a team.
- Communication Skills: Strong communication skills for effective collaboration with cross-functional teams.
Preferred Qualifications
- Finance Background: Experience in finance or financial data analysis.
- Machine Learning Knowledge: Familiarity with machine learning frameworks and libraries such as TensorFlow and scikit-learn.
About MarketWise
MarketWise is a collection of dynamic companies offering a diverse and comprehensive portfolio of independent investment recommendations, strategies, and tools. We are committed to driving economic empowerment and democratizing access to investing by providing high-quality insights and analytical tools to our growing subscriber base.
Join us in our mission to empower individuals to grow their wealth and navigate the financial markets with confidence.
Similar jobs
Last update: 23 minutes ago
Senior Data Engineer - AI Group
Senior Data Engineer needed for AI Group at Bloomberg, NY. Expertise in Python, ETL, and big data technologies required.
Data Engineer with Microsoft Azure and Python
Join as a Data Engineer in New York, focusing on Azure, Python, and data solutions. Competitive salary and benefits offered.
Data Engineer, Central InfraOps Analytics Team
Join AWS as a Data Engineer to drive data-driven decisions in the InfraOps Analytics Team, focusing on ETL, data lakes, and big data technologies.
Remote Data Engineer - Research
Join Stability AI as a Remote Data Engineer to build scalable data infrastructure for AI models.
Data Engineer
Join Adobe as a Data Engineer to design and maintain data pipelines, ensuring data quality and security.
Senior Data Engineer - Real Estate and Workplace
Senior Data Engineer for Real Estate and Workplace at OpenAI, skilled in ETL, Apache Spark, and Airflow.
Senior Data Engineer
Join Stability AI as a Senior Data Engineer to build scalable data infrastructure for AI models. Remote work from Germany.
Senior Data Engineer
Join Algolia as a Senior Data Engineer to design and scale data pipelines using Python, Airflow, and AWS technologies.
Part-time Data Scientist II (Python and ML)
Join Fearless as a Part-time Data Scientist II, specializing in Python and ML, to build data-driven solutions.
Machine Learning Engineer
Join OfferFit as a Machine Learning Engineer to design and scale AI platforms. Work remotely with a focus on Python, MLOps, and data science.
Cloud Data Engineer
Seeking a Cloud Data Engineer with expertise in AWS, Python, and CI/CD for a hybrid role in Hannover. Join our dynamic team!
Data Engineer
Join our team as a Data Engineer in Amsterdam, focusing on data pipelines, quality, and scaling using PySpark, Snowflake, Airflow, and AWS.
Data Engineer with Blockchain and Cloud Experience
Join Messari as a Data Engineer to design blockchain data models, build dashboards, and derive insights. Remote role with competitive benefits.
Data Engineer
Join MAJORITY as a Data Engineer in Stockholm to advance our data infrastructure and support our fintech mission.
Senior Machine Learning Engineer
Join as a Senior Machine Learning Engineer to design and deploy advanced ML solutions using Python, Spark, and cloud platforms. Remote work opportunity.
Machine Learning/AI Engineer
Join Keysight Technologies as a Machine Learning/AI Engineer to develop and optimize AI/ML models for EDA applications.
Lead Data Engineer
Lead Data Engineer role in Madrid, Spain. Enhance data infrastructure, support AI solutions, work with Python, SQL, and CI/CD.
Data Engineer at Amazon
Join Amazon as a Data Engineer, utilizing SQL, AWS, and big data technologies to impact global operations.
Founding Data Engineer
Join GovWell as a Founding Data Engineer to build scalable data infrastructure for modernizing government services.
Senior Data Engineer
Senior Data Engineer role focusing on data pipelines, quality, and cloud solutions at Moody's Corporation.
ML Platform Engineer
Join Pipedrive as an ML Platform Engineer in Tallinn. Build and maintain ML platform components for Data Scientists and ML Engineers.
Data Engineer, Data Technology and Products
Join Amazon as a Data Engineer in Luxembourg to drive data solutions with Big Data, Apache Spark, and ETL expertise.
Data Engineer
Join Etribes as a Data Engineer in Hamburg. Work on data pipelines, analytics, and cloud platforms. Flexible work, training, and benefits offered.
Machine Learning Engineer with AI/ML Experience
Join us as a Machine Learning Engineer to develop AI/ML models and applications. Work remotely with top-tier companies.