Data Engineer at paypay

Apply Now
About Who We Are
Our core mission is to bring a revolution in the ways millions of people to make payments with the speed. Creating and providing the error/bug-free, scalable payment platform is very complex, so things happens very fast every day at PayPay but it is such an encouraging and challenging environment for engineers like you!

As PayPay is jointly created by Yahoo! JAPAN, Softbank and PayTM, it is safe environment that engineers can focus on product developments. Our team is composed of people from different culture, background, knowledge and skills mingled and working together to build the best platform from scratch is definitely the excitement.

I believe that being able to work on many different components is appealing to new engineers to join us. This is once in a lifetime experience, so give it a try.
Job Description
PayPay is looking for a Data Engineer to work on our payment system to deliver the best payment experience for our Japanese customers.

Our ideal candidate is an problem solver and a learner at heart. You should have a very high degree of comfort in a programming language of your choice. We offer a flexible work schedule and you get your choice of tools (both hardware and software) and most importantly, the opportunity to work on tough problems with the brightest minds around you.
Responsibilities
・ Work directly with Data Analysts and Platform Engineering Team to create reusable experimental and production data pipelines
・ Understand, tune, and master the processing engines (like Spark, Hive, Cascading, etc) used day-to-day
・ Keep the data whole, safe, and flowing with expertise on high volume data ingest and streaming platforms (like Spark Streaming, Kafka, etc)
・ Sheppard and shape the data by developing efficient structures and schema for the data in storage and transit
・ Explore as many new technology options for data processing, storage, and share them with the team
・ Develop tools and contribute to open source wherever possible
Qualifications
・ You have previously worked on building data pipelines ingesting and transforming large number of events per minute and terabytes of data per day.
・ You have worked with Spark and Kafka before and have experimented or heard about Flink/Druid/Ignite/Presto/Athena and understand when to use one over the other. Preferralbly, you have worked with cloud based big data processing platform such as AWS EMR, Google Cloud DataProc.
・ You are passionate about producing clean, maintainable and testable code part of real-time data pipeline.
・ You understand how microservices work.
・ You can connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues.
・ You understand issues with ingesting data from applications in multiple data centres across geographies, on-premise and cloud and will find a way to solve them.
・ Proficient in Java/Scala/Python/Spark
Preferred Qualifications
• Software development experience in one or more general purpose programming languages, preferably Scala.
• Experience with implementing platform components such as RESTful APIs, Pub/Sub Systems, Database Clients.
• Experience with AWS services.
• Contribution to open source projects.
• Knowledge about the Japanese payment industry
Location
Chiyoda-ku, Tokyo, JAPAN
  NOTE: You could be transferred to any branch office PayPay owns.
PayPay Careers
• Company: PayPay Corporation
• Forms of employment: Permanent Staff
• Salary: Based on experience, skills, performance and contribution.
  NOTE: Pay day is on 25th of every month.
• Salary Increase: Reviewed based on performance evaluation and PayPay's business performance.
  NOTE: In principle, you will be reviewed for a raise once in a year.
• Bonus Pay: Given based on performance evaluation and PayPay's business performance.
  NOTE:
   1. In principle, given once in a year.
   2. The amount: more than 0~6 months worth of base salary.
   3. In addition, each position provides incentive bonus plan(s) accordingly.
• Evaluation System: You will be evaluated based on your performance and contribution to PayPay.
• Working Hours: In principle, from 10:00am to 18:45pm (actual working hours: 7h45m+1 hour lunch break from 12pm to 13pm in principle)
  NOTE:
   1. We use super flextime system which do not set core hours.
   2. Some divisions have exceptions (e.g.: regular working hours, shift work, alternative work schedule and etc.)
   3. We have overtime work.
   4. Reduced working hours for those who have to take care of their children and/or family members.
• Days Off: Saturdays and Sundays. National holidays. Year end holidays from December 29th to January 4th.
• Holidays: Annual paid leave, congratulatory or condolence leave, maternity leave, sick/injured child care leave, family care leave and etc.
• Various Allowances: Overtime allowance, late-night work allowance and commuting allowance (maximum of 150,000 yen.)
• Benefits: Social insurance (health insurance, employee pension, employment insurance and compensation insurance,) defined contribution pension system (TBC) and etc.
• Training Program: We have various training programs for different kinds of needs.
• Contract Period: Employment at will.
• Probationary Period: In principle, we regard the first 3 months as the probationary period.
• Retirement Age: 60 years old.
• Others: PC and phone are given (based on the company’s regulations)