Job Title:
Senior Data Engineer

Company: Primis

Location: New York City, NY

Created: 2024-04-24

Job Type: Full Time

Job Description:

Senior Data EngineerHybrid - NYCOur client is looking for a Data Engineer with experience in building and optimizing data pipelines, performing ELT processes, and working within a modern data stack.The experience expected from applicants, as well as additional skills and qualifications needed for this job are listed below.Top 3 skills needed: BigQuery, DBT, Airflow (or another orchestrator) Responsibilities:Collaborate with cross-functional teams and stakeholders to understand data requirements and implement solutions accordingly.Work closely with data scientists to implement efficient ELT processes and performant SQLEnsure data observability, quality, and integrity throughout the data pipeline.Utilize orchestration tools such as Apache Airflow, Dagster, or Luigi to manage and schedule dbt workflows.Optimize and tune existing data pipelines for improved performance, lower cost, and scalability.Design, develop, test, and maintain data architecture to facilitate the extraction, storage, and transformation of raw data for downstream utilization by data scientistsRequirements:5-8+ years of experience in data engineering or a similar role.Proficiency in building and maintaining data pipelines using tools like Luigi, Dagster, Apache Airflow, or similar.Programming skills in Python with a strong sense of engineering best practices.Experience working with cloud-based data storage solutions (ideally Google Cloud Storage)Familiarity with dbt best practicesExperience with SQL for querying and manipulating large datasets.Familiarity with data modeling concepts and tools.Experience in working with columnar warehouses (ie Bigquery) and relational databases (ie Postgres)Compensation: $160,000-$190,000 base + equity **No visa sponsor/transfers available at this time. ** No C2C/C2HResearch indicates that men will apply to a role when they only meet 50-60% of the descriptions, however, when looking at women and other minority groups, they can look for up to a 99% match in order to apply to a role. If you feel you are a fit for our role, please still apply, don't worry if you don't tick every single box. We'd still love to hear from you. We encourage underrepresented talent to apply to all our roles & support accessibility needs.