This site is also available in: Deutsch (German)
Data warehouse to fulfill regulatory requirements in the financial sector
Data Warehouse & Reporting Platform
As part of this project, we were jointly responsible for ensuring compliance with regulatory requirements in the financial sector. The following tasks played a central role in this:
Design of the data warehouse (DWH): Our task was to design a high-performance data warehouse capable of processing and storing large volumes of data. The DWH formed the basis for fulfilling the regulatory reporting requirements.
Provider management: We were responsible for working with an external data provider who supplied us with the required data. This included coordinating the data deliveries, ensuring data quality and solving any delivery problems.
Software design and implementation: Together with the reporting department, we designed, implemented and rolled out a customized software solution. This solution enabled automated data checks to monitor the quality of information from different providers.
Requirements analysis: We carried out a detailed analysis of the requirements to ensure that the software solution developed contained all the necessary functions and met the needs of the various departments. In addition to the purely technical requirements, a large number of quality features were also worked out, which were taken into account in the design and implementation of the software.
OpenShift deployments: As part of the project, we deployed the software solution on the OpenShift platform to ensure a scalable and reliable environment for running the applications.
The challenge was to deal with a significant amount of data coming from different sources. We also had to ensure that the information could be consolidated in (quasi-)real time and presented in various reports and dashboards. Thanks to the successful implementation of this project, regulatory requirements were met and reporting efficiency was significantly improved.
Problem definition
Technologies & Tools
- Python
- Angular
- Snowflake
- SQLAlchemy
- OpenShift
- Pandas
- FastAPI
- ArgoCD
- PyCharm
- DBeaver
- Visual Studio Code
Activities
- Data Warehouse design
- Vendor management
- Software design & implementation
- Requirement Analysis
- OpenShift deployments
- Development of dashboards