Evergreen Technologies
Evergreen Technologies is looking for a Senior Principal Data Engineer- SecureWorks- 100% Remote – DLL #RemoteJavaJobseeker #JavaJobWebsitesRemote #DataEngineerJobs #EngineerJobs
Senior Principal Data Engineer- SecureWorks- 100% Remote Your responsibilities include: Designing and building highly available and scalable data pipeline systems Optimizing performance from point of ingest to analytics Implementing Infrastructure as code, including dashboarding metrics and monitoring performance Scaling of data flow infrastructure to meet load while optimizing cost Essential requirements 10+ years of software development experience Degree in Computer Science or equivalent. A graduate school degree, MSc, or PhD is a plus. Excellent system design, coding, and algorithm skills Knowledge of data ingest techniques (e.g., historical vs. stream processing) and related technologies (e.g., Hudi, Apache Flink, Spark, Spark Streaming, Kafka-Connect) Performance tuning Spark or Flinkjobs Performance turning large scale Kafka Clusters Proficiency in one or more of these languages: Java, Scala, Golang Excellent analytical skills, specifically, being able to come up and reason about the design of analytics applications AWS (Amazon Web Services) S3 / AWS Glue / EMR Docker or similar containerization technology Desirable Requirements Experience with messaging middleware like Kafka, ActiveMQ, JMS Experience with Hudi, Flink, Kubernetes, Cassandra Experience with Apache Airflow, Apache Livy Experience with CI/CD pipelines Experience in managing Infrastructure as code using Terraform Experience setting up monitoring using tools such as Cloud Watch, Datadog, and Statsd
Evergreen Technologies