Junior Data Engineer
Alphanove consultancy is a technology partner helping organizations to achieve their vision by providing Strategy, Technology roadmap consultancy, and Engineering services. We are NextGen business leaders who would like to bring in a mind shift change in outcomes we target and recognize & reward success from its efforts. We build our synergy amongst people to showcase belongingness to our employees and clients as one.
We are looking for tech-passionate individuals who are looking to start their careers in the IT industry.
This is a hybrid working role and would be expected to be in our East London office 3 or 4 days a week.
Responsibilities
- Build reliably tested and documented python packages.
- Use python to call APIs, and clean and flatten the data
- Experience with JavaScript and Web development is a plus.
- Deploy these python packages to our existing scheduling and infrastructure orchestration system.
- Understand concepts of Data Lake and Data Warehouse.
- Use DBT to model, validate and document data into Facts and Dimensions.
- Build data visualization dashboards to meet stakeholder needs.
- Work with various stakeholders to understand the data they use, where they collect it from, and how we can automate their workflow.
- As a Data Engineer you'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyze their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimizing the data pipelines for scalability and performance will be a focus.
- You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data scientists and analysts to use.
Qualifications
- Programming experience in SQL, Python, or scala
- Knowledge of data storage technologies such as data lakes, data warehouses, and traditional SQL/NoSQL databases
- Good understanding of Apache Spark, Databricks, or Hadoop
- Knowledge about CI/CD, docker, K8 Join us in Building Technology with Passion.