Job Responsibilities: Data Engineer
Salary: $20-30/Hour
Company: Apple
Location: USA
Educational Requirements: Bachelor's Degree
Full Job Description:
The folks at Apple didn't just create products, they created amazing things that changed the entire industry. It's the diversity of these people and their ideas that drive innovation in everything we do, from amazing technology to groundbreaking environmental efforts. Join Apple and help us leave the world better than we found it. Apple's Manufacturing Systems and Infrastructure (MSI) team is responsible for recording, supporting, and tracking all manufacturing data for Apple products and modules worldwide. We are a collaborative team that tackles complex software engineering problems across multiple Apple manufacturing projects. Apple MSI is looking for a DevOps Engineer with some data engineering experience who can help lead the next generation of products we're building. Our infrastructure team is responsible for architecting, building and optimizing the distributed systems that enable Apple to create each product. You should try to make life easier for everyone who uses the system, especially the development team. This means automating everything from project entry, to operations, to CI/CD systems, to setting up monitoring and reporting, using cloud and container technologies, and creating data pipelines, ETL, and security solutions.
5+ years with a concentration in one area: DevOps or Data Engineering and hands-on experience in the other area.
Experience with Java, Scala, Kotlin, Python, Elixir, Rust or equivalent programming language. Good automation skills in Python/Go following coding best practices, or any scripting language like Bash or another shell language. DevOps
Qualification Required –
Experience in building distributed and macro/microservice architectures using Container and Cloud technologies
Experience with SDLC practices and building stable CI/CD systems with pipelines such as code paths
Linux Basics and Commands, Operating Systems, Installing/Uninstalling Applications, Troubleshooting
Understanding of security concepts for data pipelines and experience working with messaging queues (RabbiqMQ, HiveMQ, Kafka, etc.)
Knowledge of cloud infrastructure, networks, load balancers, firewalls and WAF
Experience with monitoring and alerting tools such as Splunk, AppDynamics, Prometheus, ELK, TICK stack, Grafana, etc.
Support tools and technologies to be named are: Docker, Containers, Kubernetes, Helm, Ansible, Saltstack, Jenkins pipeline, Gitflow
Required Skills in Data Engineering -
Deep expertise in SQL, data structure and data management in relational databases
Works with a wide range of data storage and analysis tools, including current distributed technologies: Druid, Snowflake, SparkSQL, Presto, Hive, Kafka, Redshift or parallel architectures and plugins.
Experience using ETL / ELT tools and technologies: Reltio, Stibo, Informatica, Apache Atlas, Linkedin DataHub, Lyft Amundsen, Netflix Metacat or Uber Databook or DBT is beneficial.
Building a data streaming system (both batch and streaming) using Apache Spark, Storm/Flink/Flume preferred
Explanation
Join our team and be a part of this fast-paced environment, with lots of exciting projects! As a team leader in our team, you will work closely with system and software developers, operators and contract manufacturers to build/deploy and maintain software n 'time in the industrial sector. You will help design and deploy client applications on Mac/Linux/iOS platforms and work with cross-functional teams to deliver our applications to our large supply chain and help build the future of our production systems in real time. You can create data pipelines and ETL data from these tools. It's a rare opportunity to add your signature to how Apple does everything.
Main job
Be part of a manufacturing company and a team of skilled engineers, contributing to the ever-changing equipment / operation space - from design from scratch to its processing. You will also be responsible for the main data platforms that enable the collection and storage of data for Apple Product Services.
Configure, deploy and monitor apps and devices on desktop devices and configure integration with cloud-based platforms. You will create, develop and maintain a large data pipeline, storage and processing services for data coming from these devices Provide support for applications and network latency issues, as well as various operational functions such as applications control and input .
