Are you a seasoned Lead Data Engineer ready to take the helm of enterprise-level data services? If so, this is your chance to be the architect behind the evolution of our robust data pipelines and architectures, propelling our tech stack into the future. Your expertise will be pivotal in infusing a product-centric approach into the creation of versatile data services. Collaboration is key - you'll forge strong alliances with a host of departments, catalyzing data innovation. Additionally, you'll have the opportunity to demonstrate your strategic acumen by crafting and presenting compelling roadmaps to our senior leadership, all while nurturing a dynamic, agile workspace.

Key Responsibilities

• Oversee the management of Snowflake as a platform hosting our internal data marketplace, optimizing performance, and ensuring data integrity throughout the entire application development lifecycle, up to the point of last-mile consumption.

• Implement FinOps best practices to optimize cloud costs, manage budgets, and drive cost efficiency across all data engineering activities.

• Propel our development process by integrating CI/CD automation, ensuring smooth and rapid deployment, and fostering a culture of continuous improvement and efficiency.

• Establish and preserve a robust, scalable, and secure infrastructure for our APIs.

• Collaborate with our data science team to decipher intricate business challenges and actualize triumphant solutions.

• Leverage the strength of teamwork, collaborating with diverse teams - data scientists, product managers, software engineers - to comprehend and fulfill our data requirements.

• Steer the AWS data infrastructure, ensuring rapid data delivery and supreme accuracy.

• Direct the complete lifecycle of the data pipeline to satisfy our bold business needs - from data ingestion and ETL, to provisioning and visualization.

• Pioneer the adoption of Test-Driven Development (TDD) practices within our team, boosting quality and efficiency.

• Foster a vibrant, agile development atmosphere, championing agile methodologies with a steadfast customer-first mentality.

• Devise and implement groundbreaking strategies for data acquisition, archive retrieval, and database execution.

• Communicate data engineering tactics, insights, and advancements to our senior executives.

• Maintain data engineering best practices across the team, including proficient CI/CD automation, setting high standards, and encouraging excellence at every juncture.

• Be a vital component of our team culture, committing to office-based collaboration three days a week in our Boston, MA (preferred) office.

Required Qualifications

• Bachelor's degree in computer science, Information Systems, or a related field.

• Minimum of 10 years’ experience in a data engineering role, with 3 years in a lead role.

• Strong experience with AWS technologies, such as S3, EC2, EMR, RDS, Redshift, and Glue.

• Experience with Snowflake data warehouse is essential.

• Proficient in SQL and programming languages like Python, Java, etc.

• Excellent understanding of data pipeline and workflow management tools such as Airflow, NiFi, etc.

• Familiarity with stream-processing systems: Kafka, Kinesis, etc.

• Deep understanding of test-driven development (TDD) and API design.

• Knowledge of professional software engineering practices for the full software development life cycle.

• Strong problem-solving skills, algorithmic skills, and data structures.

• Experience in agile methodologies like Scrum, Kanban, etc.

• Demonstrated ability to present technical information to both technical and non-technical stakeholders, including senior executives.

• Proven experience working in a product-focused environment, driving product strategy and roadmap.

• Excellent communication, leadership, and team management skills.

About Our Company
We’re a diversified financial services leader with more than $1 trillion in assets under management and administration. Our team of 20,000 people in more than 20 countries advise, manage and protect the assets and income of more than 2 million individual, small business and institutional clients. We are a long-standing leader in financial planning and advice, a global asset manager and an insurer. Our unwavering focus on our clients and strong financial foundation connects each of our unique businesses - Ameriprise Financial Services, Columbia Threadneedle Investments and RiverSource Insurance and Annuities. Here, we foster meaningful careers, invest in the future, and make a difference for clients, institutions and communities around the world.

Full timeExemptTechnologyTECH Technology