Lead Software Engineer (Data)-7999
Generate a McCoy IQ challenge in 30 seconds.
See how candidates think and approach the work this role demands, before the phone screen. We'll build a video challenge from this posting, and you can edit or share it before it goes live.
Key details
Job Description
Job Summary
Job Description
DUTIES: Provide technical leadership to a team responsible for developing data processing software using Apache Flink; design extract transform-load (ETL) data pipelines based on company’s proprietary ETL development library, using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; store structured data using Hbase; develop business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; develop streaming data pipelines using Apache Kafka; store data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; automate tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting; support applications under development and customize current applications; assist with the software update process for existing applications, and roll-outs of software releases; analyze, test, and assist with the integration of new applications; document all development activity; research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports; monitor and evaluate competitive applications and products; review literature, patents, and current practices relevant to the solution of assigned projects; collaborate with project stakeholders to identify product and technical requirements; conduct analysis to determine integration needs; work with the Quality Assurance team to determine if applications fit specification and technical requirements; and guide and mentor junior-level engineers. Position is eligible to work remotely one or more days per week, per company policy.
REQUIREMENTS: Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and seven (7) years of experience developing data processing software using Apache Flink; of which five (5) years of experience include designing extract transform-load (ETL) data pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; storing structured data using Hbase; and developing business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; of which three (3) years include developing streaming data pipelines using Apache Kafka; storing data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; and automating tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting.
Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Skills
Apache Flink, Apache Kafka, HBaseWe believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Please visit the benefits summary on our careers site for more details.
Audit details(provenance, verification trail, raw fields)
Core fields
comcast:R441332Provenance
wd5|comcast|Comcast_CareersVerification trail
This posting hasn't been probed by our closure verifier yet. Stream C runs on a rolling schedule against postings approaching the close-decision threshold.
See how we measure for definitions, or our corrections log for known issues. Found something wrong? Flag a correction.
