Hy Community,
I'm currently searching for a tool in the field of KPI Data Management. The current idea is to have a lot of ETL Processes in Azure Data Factor filling a simple SQL Database with around 100 predefined KPIs which are defined to manage this global active SME with about 2k employees.
What's missing is an interface to access this "KPI Database" for non-technical people. I dreamed of something like a Dictionary or KPI Catalogue where someone from any specialist department can look up which KPIs are available. More meta-information is also stored: Who is the KPI/data-owner, data steward, and how can one access this KPI? Maybe even generate some API/SDK, excel-import, etc.?
Do I dream too big? Please hit me, even if it's just another keyword I should consider using to search further.
Thanks in advance and best, Malte
Hi Malte
Your dream is really good, and most companies are on this journey.
One option that you can consider for non-technical staff is a Data Catalogue. This gives you the technical meta-data and links it to a business glossary. If you are in the Microsoft ecosystem, consider a service like Microsoft Purview for your requirements.
Kind Regards,
Sarath
@Sarath Boppudi thank you very much, that confirms my additional research in that topic. So the Keyword ist "Data Catalogue". I'll definitly have a look into Purview. Thank you!
Hey Malte,
I agree with @Sarath Boppudi. A Data Catalog may be a good fit for your needs. We have used OpenMetadata and Apache Amundsen (by Lyft). Both of them are open source. Give them a try!!!
Cheers, Alfredo
You're welcome Malte!!! And if you want to make great dashboards using open source, give also a try to Apache Supersets.
Cheers,
Alfredo
Without doing free research to find out a little more, which pays much less than it used to, here are some starters for data management and integration. Start with Celigo and Dell Boomi - I don't know what's their wheelhouse but they could tell you more than I. We have had some clients create 'drag and drop' interfaces for managing data between databases. You can also use BI tools Qlik and Tableau to create the integrations and then be able to manage the datasets from there. Anaplan is probably way off base, but check. Hope this helps - our practice is more on the business side than the IT side, so we're focusing on end-user functionality and working from that direction.
@Gene Hammons fair points you point out here. I'll give them a shot! Boomi I've seen earlier already - let's see how it turns out. And yes the idea was to use BI-Toolings on top - but enhancing the datasources with meta-information right before the BI tool itself, as there are more applications which need to consume the data.