Job Description:

(This position is based in Trepp's NYC office which operates in a hybrid work schedule)Considering making an application for this job Check all the details in this job description, and then click on Apply.The Data Engineering Manager is responsible for leading the migration of legacy systems to the Data Lake and providing technical leadership in support of Trepp's initiatives in data ingestion and pipeline automation, with a focus on the design and implementation of Spark/EMR and streaming platforms. The Data Engineering Manager reports into the Data Engineering organization.The ideal candidate will have a bachelor's degree in Computer Science or closely related subject; an advanced degree is preferred. In addition, 7 or more years' experience in migrating complex IT systems in enterprise organizations. The position requires strong technical skills and must be able to collaborate effectively with a group of high performing individuals. The position requires an individual who can collaborate on setting mid/long term goals and objectives, then be self-directed to estimate timelines and take ownership of the work, while communicating with stakeholders on a regular basis. The data engineering manager role sets an example for junior team members through modelling best practices and provides guidance during weekly team calls, feedback through code reviews etc., and generally supports the knowledge and skills development of junior team members.Data Engineering, Design and Development Requirements: This role is expected to lead & manage a team but will be hands-on 70-80% of the timeEnsure the delivery and accuracy of data from external vendors and internal data-producing groups.Work within the Platform Pipelines team to implement modern architectures for data collection, processing and storage. You'll be working with 3rd party partners & vendors along with internal data sources.Consult senior-level stakeholders across the entire organization to identify business and technology needs and to optimize the use of technology, systems, and software toolsProvide robust operational support for systems when there are issues or questions with data accuracy or processing.Develop a technology roadmap of projects to enhance current processing and modernize systems taking advantage of Cloud architectures.Analyze existing data operations processes and identify opportunities for efficiency gains. Demonstrate knowledge of batch and streaming pipelines technologiesBe responsible for core analytics, data lake and date pipeline products.Demonstrate knowledge of Data Quality and Data Governance.Build data applications, products, integrate with third-party data and technology platforms.Demonstrate expertise in comprehension and construction of complex SQL queriesAct as a Subject Matter Expert to the organization for Trepp's ingestion frameworks, including AWS and future providers, networking, provisioning, and managementDemonstrate leadership ability to back decisions with research and the "why," and articulate several options, the pros and cons for each, and a recommendationMaintain overall industry knowledge on latest trends, technology, etc.Demonstrate application of Realtime vs Batch pipelinesQualifications: Bachelor's degree in computer science, systems analysis or a related study, or equivalent experience4+ years managing an engineering team.7+ years of experience with Python or Java, or Scala and AWS (Lambda, ECS, EMR)7+ years of experience with SQL (DDL, DML, complex queries)Experience with SQL RDBMS implementations and RDS is a plusExperience with AWS enterprise implementations (Lambda, ECS, Spark, Kinesis, DMS)Experience with Spark / EMR (or similar) implementationsExposure to multiple, diverse technologies and processing environmentsKnowledge of components within a technical architectureExperience with Agile and SDLC, Git workflows, and CI/CDStrong preference for process and documentationStrong understanding of network architecture and application development methodologies.Preferred Skills: A drive to work on financial data systems & pipelines including experience working with structured finance or commercial real estate datasets.Understanding of serverless architectures, containers, and modern application development practices.Ability to quickly learn, understand, and work with new emerging technologies, methodologies, and solutions in the Cloud/IT technology space.Experience working in Financial Services or related industry.Salary Range: Base salary starting from $180k plus bonus eligibleBenefits and Perks:Base + target bonus compensation structureMedical, Dental, Vision insurance401K (with employer match)Life insurance, long term disability, short term disability all covered by the companyFlexible paid time off (PTO)Sixteen (16) weeks paid primary caregiver leave (Biological, adoptive, and foster parents are all eligible)Four (4) weeks paid parental leaveWellness subsidyPet insuranceLaptop "‹+ WFH equipment"‹Career progression planPre-tax commuter benefit with company subsidy (For NYC-office based employees only)Involvement in Diversity and Inclusion programsFun company events and volunteering opportunitiesWorkplace Policy:NYC, Dallas, PA, and London office-based positions: Trepp's offices follows a 3-2 hybrid-working policy with the expectation of in-office work on Tuesday-Thursday and the option to work from home on Monday and Friday.Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with Trepp (i.e., H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status).Trepp, Inc. is an equal opportunity / affirmative action employer, complying with all laws governing employment in each jurisdiction in which operating, and provides equal opportunity to all applicants and employees. All qualified applicants will be considered without regard to race, color, religion, gender, national origin, age, disability, marital or protected veteran status, sexual orientation, gender identity and other status protected by applicable laws.