Your primary responsibility will be developing transformation logic against disparate datasets into Aetion's proprietary format. You will work closely with our Science team in developing this logic, which is in SQL and Scala UDF and executed over a Spark cluster. In addition, you will be integral in developing and enhancing our ELT process which utilizes Apache Airflow (python), Spark/Databricks and a combination of Java/Scala to develop data ingestion infrastructure.
The following duties include, but are not limited to:
Aetion is an Equal Opportunity Employer. Aetion is committed to being an employer of choice, not just a good place to work, but a great and inclusive place to work. To that end, we strive to recruit and maintain a workforce that meaningfully represents the diverse and culturally rich communities that we serve. Qualified applicants will receive consideration for employment without regard to their race, color, religion, national origin, sex, sexual orientation, gender identity, protected veteran status or disabled status or, genetic information.
It's easy, and free! Add jobs from any website! Get recommendations from your friends! Start by adding this job...