Job: Big Data Engineer at PicsArt LLC Company

Location: Yerevan, Armenia

Category: information technology

Type: Full Time

Deadline: 15-Oct-19 12:00:00 AM

Salary:

Description

Responsibilities

- Help drive the long-term big data architecture and infrastructure by working in conjunction with Product Management to align with business goals
- Act as a part of the architectural team
- Develop and operate our data pipeline & manage data infrastructure
- Work closely with analysts and data scientists and help to develop data-driven dashboards and systems
- Take on some of the most significant problems in high-performance, scalable analytics
- Monitor performance and advise on any necessary infrastructure changes
- Leverage big data processing and automation with Python, Scala, Spark, Hive, Spark Streaming, and more
- Translate application storyboards and use cases into functional applications
- Analyze and optimize query/script performance
- Identify bottlenecks and bugs, and devise solutions to these problems
- Train and mentor new and junior team members

RequiredQualifications

- BS/MA degree in a highly quantitative field or equivalent
- Experience with complex distributed systems and service oriented architectures
- Experience with big data tech stack (Hadoop, HDFS, HBase, Kafka, Spark, Spark Streaming, Presto, Hive, Flume, Samza, Yarn)
- Experience with Python and Scala
- Knowledge of SQL
- Knowledge of concurrency patterns
- Understand fundamental design principles behind a scalable application
- Experience in building stream-processing systems, using solutions such as Spark-Streaming is a plus
- Knowledge of various ETL techniques and frameworks, such as Flume is a plus
- Knowledge of Java (or other OOP language) is a plus
- Knowledge of Bash Scripting is a plus
- Ability and willingness to learn new technologies
- Advanced written and verbal English communication skills Familiarity with:
- Various design and architectural patterns
- Big data processing architectures
- Code versioning tools, such as Git
- Build tools such as Maven or Gradle
- Continuous integration

Benefits

Job URL: iJob.am - Big Data Engineer @ PicsArt LLC