Job: Big Data Engineer at PicsArt LLC Company

Location: Yerevan, Armenia

Category:

Type: Full Time

Deadline: 20-Jul-19 12:00:00 AM

Salary:

Description
PicsArt is actively seeking a talented Big Data Engineer to join its software development team. The ideal candidate will work in Big Data Infrastructure and must determine technical requirements, make architectural decisions, create/ design documents, develop, test and insure the best possible performance and scalability of the system. The incumbent will be working in an environment with more than 1000 servers in 4 data centers on different continents, delivering over 95 billion monthly requests and 10Pb monthly traffic. The Company requires professionalism in both soft and hard skills, motivation to grow, learn and share, positive attitude, flexibility, transparency, ownership, enthusiasm and commitment.

Responsibilities
- Help drive the long-term big data architecture and infrastructure by working in conjunction with Product Management to align with business goals;
- Act as a part of architectural team;
- Develop and operate the data pipeline and manage data infrastructure;
- Work closely with analysts and data scientists and help to develop data-driven dashboards and systems;
- Take on some of the most significant problems in high-performance, scalable analytics;
- Monitor performance and advise on any necessary infrastructure changes;
- Leverage big data processing and automation with Python, Scala, Spark, Hive, Spark Streaming, and more;
- Translate application storyboards and use cases into functional applications;
- Analyze and optimize query/ script performance;
- Identify bottlenecks and bugs, and devise solutions to these problems;
- Mentor junior engineers and data scientists on the team.

RequiredQualifications
- At least 3 years of experience as a Software Engineer;
- At least 1 year of experience as a Big Data Engineer;
- Experience working with complex distributed systems and service oriented architectures;
- Working knowledge of big data tech stack (Hadoop, HDFS, HBase, Kafka, Spark, Spark Streaming, Presto, Hive, Drupal, Flume, Samza, Yarn);
- Working experience with Python and Scala;
- Strong SQL skills;
- Understanding of fundamental design principles behind a scalable application;
- Knowledge of concurrency patterns;
- Proven ability and willingness to learn new technologies.

Familiarity with:
- Various design and architectural patterns;
- Big data processing architectures;
- Code versioning tools, such as Git;
- Build tools such as Maven or Gradle;
- Continuous integration.

PREFERRED QUALIFICATIONS:
- Experience with building stream-processing systems, using solutions such as Spark-Streaming;
- Knowledge of various ETL techniques and frameworks such as Flume;
- Knowledge of Java (or other OOP language);
- Working knowledge of Bash Scripting.

Benefits

Job URL: iJob.am - Big Data Engineer @ PicsArt LLC