Profile
Experienced software engineer and data architect with a background in consulting across various industries in Germany. Heavy focus on Python.
Started as a C++ and SQL developer, moving through roles such as testing consultant and embedded systems developer. Shifted focus to cloud technologies in 2017, specializing in Azure.
Using Emacs.
Freelancing since late 2019, focusing on Microsoft Azure and Databricks for data engineering, with significant DevOps experience using Azure DevOps, GitHub, and GitLab.
Languages
- German
- English
- Bosnian
- Croatian
- Serbian
Freelance Projects
Data architect
Designing a new data platform 04.2024 - present Client:![RTL Deutschalnd](assets/pictures/RTL_Logo_2021.svg.png)
![Bertelsmann](assets/pictures/Bertelsmann_Logo_2016.png)
Architecting a new solution for data storage and processing using Azure SQL Server for storage and Databricks for processing and orchestration. Demonstrating the same solution using Delta Lake together with Unity Catalog enabled features like Delta Sharing, column masking, row-level security and access management (ACL).
Data engineer and lead developer
Designing and managing ELT pipelines with Azure Databricks 06.2023 - 04.2024 Client:![RTL Deutschalnd](assets/pictures/RTL_Logo_2021.svg.png)
![Bertelsmann](assets/pictures/Bertelsmann_Logo_2016.png)
Implemented ELT pipelines for a large media client to streamline data ingestion from various sources (cloud storage, REST APIs, BigQuery etc). Utilized Azure Synapse to orchestrate data flows, Databricks for data transformation and processing, and Azure SQL Server for data storage. Enhanced data reliability and performance through automated monitoring and alerting, ensuring timely insights for business intelligence reports. Later on we changed the system and dropped Azure Synapse for Databricks Workflows which was a great move. Used Databricks bundle deployments for configuring and deploying workflows and configuring clusters.
Data architect and engineer
Microsoft collaboration on designing a system for multiple Data Catalog integration 07.2022 - 06.2023 Client:![Bertelsmann](assets/pictures/Bertelsmann_Logo_2016.png)
This project involved the integration of various data catalogs, including Acryl (based on DataHub), Microsoft Purview, and custom catalogs sourced from databases, into a unified system — Microsoft Purview. The tasks included synchronizing entities, glossaries, and term hierarchies from external catalogs using the underlying Apache Atlas API. The solution was designed to be event-driven, leveraging Azure Event Hub and Azure Service Bus. The orchestration was implemented using Azure Durable Functions. Azure Table Storage was employed as the state store.
Data engineer
Improving a Databricks based solution 01.2022 - 07.2022 Client:![BASF](assets/pictures/BASF-Logo_bw.png)
Utilized the Enterprise Data Lake Platform to prepare data for the Data Science Platform. The primary data sources were SAP systems, which provided significant daily data volumes. Pipeline orchestration was managed through a custom solution implemented in SQL Server, responsible for state management of jobs, tasks and records.
API developer
Blueprint for API Development: Standardizing Processes with FastAPI and Azure Services 11.2021 - 01.2022 Client:![vattenfall](assets/pictures/vattenfall_logo.svg.png)
I designed a comprehensive blueprint for API development utilizing FastAPI and Azure services, which has been adopted by multiple teams within the organization. This blueprint standardizes the creation and deployment processes for APIs, thereby improving development efficiency and ensuring consistency across various projects. Tools used are Azure API Management, Azure App Services ans FastAPI.
Data Engineer
Creating a Delta Lake and Masterdata management platform 02.2020 - 12.2021 Client:![essity](assets/pictures/essity_logo.svg.png)
The project involved the harmonization of data to establish master data, the creation of a data lake, and the development of data pipelines utilizing Data Factory. Data processing tasks are handled using Databricks, while Azure DevOps is employed for the deployment of both pipelines and databases. Additionally, SQL Server is utilized to enhance analytics performance, providing improved integration with PowerBI. Also, managed the migration of projects from MS Azure DL1 to DL2. My role involved both development and design work, ensuring efficient data storage and access.
Application Developer and Data engineer
Creating a knowledge management platform 10.2019 - 02.2020 Client:![eon](assets/pictures/EON_Logo.svg.png)
Implemented a robust internal knowledge management system leveraging Django and Azure Cognitive Search, which facilitated efficient information retrieval and enhanced organizational knowledge sharing. Utilized Docker for containerization and GitLab CI/CD for streamlined deployment. Additionally, employed Bash scripting for automation tasks.
Employment
Senior Consultant
Promantis GmbH 04.2018 - 12.2019Was the Senior Consultant for Data questions at Promantis. Worked only for one client - e.On. My focus was on Data Engineering and application development. Once the data was in the Data Lake there was a need for different platforms to be created in order to make that data most accessible for internal users. Those users were Data Science teams as well as the management.
System developer and Architect
Cognotekt GmbH 05.2017 - 04.2018As a senior back-end developer, I developed and maintained core applications for AI-based services in the insurance industry. My role involved writing new modules and integrating them into existing C++ applications. I also prototyped a recommender system in Python using Frequent Items Mining, contributing to improved customer recommendation strategies.
Senior Developer
Syniverse 03.2016 - 05.2017At Syniverse, I focused on enhancing legacy code for Fraud Detection and Revenue Assurance software. I led technical efforts on a project for Roshan Telecom, using C++ and Oracle SQL/PLSQL. This project earned industry awards for its successful implementation.
Systems Applications Developer
E.Solutions GmbH 03.2013 - 03.2016I developed system applications for Audi/Volkswagen's MMI products, focusing on modules for device updates. Working in C++ on the QNX operating system, my contributions ensured the reliability and performance of software used in millions of VW group vehicles.
Developer and System Designer
ZIRA 10.2008 - 02.2013At ZIRA, I worked on both rating and billing systems, developing core applications and modules. I significantly contributed to the fraud detection system, specifically the Profiling Engine, which was successfully deployed in major telecom companies.