As a Data Engineer at KONUX you will be responsible for managing a large research data lake that is growing rapidly in both size and complexity. You will take pride in ensuring that the data science team has the best possible access to well organized data sources. You will also act as an interface with our production team, ensuring alignment of model data requirements. You will, of course, be automating data management processes and be responsible for data cleansing. Ideal candidates learn and adapt quickly and will be able to use every tool at their disposal to understand and effectively tackle hard problems. You will be working in a Linux environment.
Ensure the consistency and quality of a wide range of raw data sets, including millions of time series recordings from the field
Provide database support and management of research model input and output data, including preparation of schema
Create functional specifications and schema for new and existing data management processes
Manage our data lake infrastructure, including services like Spark, Hive or AWS Glue/Athena
Write interfaces to other systems for data gathering and data acquisition
Develop data acquisition monitoring and accounting processes that alert users to missing data
Automate the data cleansing and data pruning processes
Assist with the development of the back-end (and design, and / or front-end too) for web-based data visualization applications
A degree in Computer Science, Engineering, or a related field
3+ years in a Data Engineering or very similar role
Advanced proficiency in Python and Apache Spark
Advanced knowledge of different database technologies SQL, NoSQL, object-relational databases
Experience in database schema design and database management in a business environment
Ability to understand and deliver in a complex and rapidly evolving data and product environments
Demonstrated examples of working with business partners to deliver a solution that meet project objectives (requirements generation, functional specification generation to project execution)
Familiarity with the fundamentals of machine learning
Strong interpersonal communications skills (verbal, presentation and written)
Autonomous and solution oriented working methods
An understanding of traditional business intelligence and data warehousing concepts (ETL, data modeling, and reporting)
At KONUX, we are empowering the rail industry by building the best possible predictive analytics solutions for our customers. We strive to help industrial companies improve their maintenance and performance decision making in a data-driven world. A career at KONUX is for those who want to be at the forefront of analytics, working to make notable improvements to train reliability which affects hundreds of commuters every day. Our culture prioritizes the customer first, and all employees are expected and empowered to take ownership of their daily responsibilities. If this sounds like the type of environment you thrive in, then we want to hear from you!
At KONUX, we focus on results. We believe that a diverse team achieves better results faster. So here’s the deal: You bring in your very own perspective. We promise to judge your qualifications and performance, not your age, sex, religion, skin color, gender identity, family status or disability.