Senior Data Engineer
About the Team
The Data Platform and Solutions team builds and maintains the data platform that ingests data from various data sources, transforms that data and maintains the business logic, then pushes out that data to power our reporting, our AI/ML features, our critical customer-facing applications and APIs, and fuels our GTM systems to empower CircleCI to be the premier data-driven company in the CI/CD space.
About the Role
CircleCI is seeking an experienced Data Engineer to own and further develop our data infrastructure, ingestion, and to help us build our data products. This will include data ingestion/validation/alerting, AI/ML systems, and customer-facing APIs. As the initial data engineering hire, you'll work independently while collaborating closely with both engineering and other data teams to build robust, scalable data systems. We’re seeking someone with a voracious appetite for solving complex problems and who can innovate and collaborate with teams across CircleCI.
Key Responsibilities
Design and implement data architectures that support efficient data flow across the organization
Build and maintain event-based logging systems to ensure comprehensive data capture
Establish and enforce data contracts to maintain data quality and consistency
Optimize data infrastructure costs while maintaining performance
Create and maintain data pipelines using modern orchestration tools
Partner with analytics engineers to ensure data availability and reliability
Evaluate and implement new data tools and technologies as needed
Required Qualifications
5+ years of experience in data engineering roles
Strong expertise in Python and SQL
Proven experience with modern data warehousing solutions, particularly Snowflake
Deep understanding of database systems, including PostgreSQL
Hands-on experience with data integration tools like Fivetran
Knowledge of CI orchestration tools like CircleCI or dbtCloud
Proficiency with data pipeline orchestration platforms like Apache Airflow
Experience with modern data transformation tools, specifically dbt
Track record of implementing event-based logging systems
Strong background in data modeling and architecture design
Required Skills
Self-motivated with ability to work independently
Excellent problem-solving and analytical skills
Strong communication abilities to work effectively with both technical and non-technical stakeholders
Experience in implementing and maintaining data quality standards
Proven ability to optimize data infrastructure costs
Experience with data contract design and implementation
Preferred Qualifications
Experience being a founding member of a data engineering team
Background in data security and compliance
Experience with batch and microbatch data processing systems
Knowledge of data observability tools and practices
Experience with GPU infrastructure management and optimization
Familiarity with ML model versioning and experiment tracking tools
Canada Base Pay Range
$133,000—$166,000 CAD
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
About CircleCI
CircleCI is the world’s largest continuous integration/continuous delivery (CI/CD) platform, and the hub where code moves from idea to delivery. As one of the most-used DevOps tools - processing more than 3 million jobs a day - CircleCI has unique access to data on how the most effective engineering teams work, and the tools to help software companies successfully leverage the power of AI into their commercial applications. Companies like Hinge, HuggingFace, and Samsung use us to improve engineering team productivity, release better products, and get to market faster.
Founded in 2011 and headquartered in downtown San Francisco with a global, remote workforce, CircleCI is venture-backed by Base10, Greenspring Associates, Eleven Prime, IVP, Sapphire Ventures, Top Tier Capital Partners, Baseline Ventures, Threshold
Ventures, Scale Venture Partners, Owl Rock Capital, Next Equity Partners, Heavybit, and Harrison Metal Capital.
CircleCI is an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.
