Data Engineer Job Description
RESPONSIBLITIES
Because we work on the cutting edge of a lot of technologies, we need someone who is a creative problem solver, resourceful in getting things done, and productive working independently or collaboratively. This person would also take on the following responsibilities:
1 Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
2 Work closely with our engineering team to integrate your amazing innovations and algorithms into our production systems.
3 Perform ETL for various datasets with complex data transformation logic in batches as well as in real-time
4 Build scalable search and indexing capability to navigate and retrieve data
5 Process unstructured data into a form suitable for analysis – and then do the analysis.
6 Support business decisions with ad hoc analysis as needed.

DESIRED SKILLS
1 Programming experience, ideally in Python or Scala, but we are open to other experience if you’re willing to learn the languages we use.
2 Hands-on Experience in data modeling and data model optimization
3 Deep knowledge and hands on experience in ETL into and from RDBMS, preferable with PostgreSQL and Oracle DB.
4 Experience with open-source ETL tools such as Pentahol and Talend is a plus
5 Proficient in writing SQL queries
6 Experience processing large amounts of structured and unstructured data. Spark and MapReduce experience is a plus.
7 Excellent programming knowledge to clean and scrub noisy datasets.
8 Deep knowledge in data mining, machine learning, natural language processing, or information retrieval is a plus
9 Strong knowledge of and experience with statistics; potentially other advanced math as well.
10 An excellent team player and communicator who can work effectively with cross functional teams.

Senior Software Engineer Job Description
Senior Software Engineer

We are looking for a Senior Software Engineer to help us migrate data from our existing enterprise service gateway to our new data management platform

RESPONSIBILITIES:
1 Architect, build, test and launch solution to migrate the entirety of our existing enterprise service gateway to the new data management platform
2 Provide timely status reports to business stakeholders
3 Work with cross-functional teams and 3rd party vendors to complete migration effort

DESIRED SKILLS:
1 Intermediate to expert proficiency with SQL.
2 Experience pipelining data (ETL) in an imperfect environment retrying through rate limits, http errors, network issues, etc.
3 Hands-on coding experience with Python is a must.
4 Experience working with data migration related to Oracle RDBMS and PostgreSQL
5 Experience working in collaborative team environment you read between the lines to judge requirements, and unblock yourself with questions aimed at your business stakeholders.
6 An excellent team player and communicator who can work effectively with cross functional teams.

公司不错！
推荐！

有兴趣的小伙伴可以试试！

已私信
向往新生活，你好！我有兴趣，已经私信你，可随时联系我。谢谢

顶
xmljz

已私信
谢谢