Everything is perfect except for the documentation and the steep learning curve that I already mentioned. That is the part for which I deducted one mark. Everything else is perfect. Portkey is a very useful software if you are going forward with your AI application that uses the LLM gateway. I would recommend you use it and you will love it within a few days.
Regarding governance and security, I would say security is quite high. In fact, one of the reasons we chose to implement Portkey is that it gives us a central control point for AI usage rather than every application managing it independently. From a security perspective, I appreciate that sensitive provider credentials are managed centrally instead of being distributed across multiple services. On the governance side, having a single layer for routing, usage tracking, and policy enforcement helps us standardize how AI is used across different teams. As more applications adopt LLMs, consistency becomes increasingly valuable. Overall, I would describe Portkey as a strong differentiator that provides visibility and centralized control. Portkey is deployed in my organization as a hybrid cloud deployment. We use AWS as part of our hybrid cloud setup. Our applications and backend services run on AWS, and all AI requests are routed through Portkey before reaching the underlying models. We have backend services and API databases on AWS. Portkey centralizes routing, observability, and cost management. This approach gives us the flexibility of managing foundation models while keeping our application logic simpler. Operational controls are within our own cloud environment, allowing us to change model providers without impacting the applications. In terms of customizing, I would say Portkey is very flexible because one of the reasons we adopted it is that it fits into the existing architecture. Most of my customization has been through configuring rather than custom development. For example, I customized different routing rules for different AI workloads. I have also integrated Portkey into my internal monitoring and engineering workflows. The best part is that our application code remains largely provider-agnostic. If we want to evaluate a new LLM or change routing for a specific use case, we typically do not need to make significant changes. I have not had to build major custom extensions to make Portkey work for us. Most of what I have needed has been supported through existing configurations. Overall, customizability is highly rated. For my organization, compliance is important, though we are not heavily regulated. From my perspective, Portkey contributes to a centralized control layer. Since all LLM traffic passes through a single gateway, it is much easier. That said, we do not rely on Portkey alone to meet compliance requirements. We combine it with our own security controls. I can share some approximate figures for faster development and better cost awareness. For development, I estimate that Portkey reduced engineering efforts by around thirty to forty percent. Previously, each team had to implement provider-specific authentication, retries, logging, and error handling. For model evaluation, we have seen about fifty percent reduction in time. From a cost management perspective, we have reduced unnecessary LLM consumption by around fifteen to twenty percent. I have also noticed thirty to forty percent reduction in troubleshooting time. Overall, Portkey has had a huge business impact in terms of cost savings and operational efficiency. I would rate this review overall at nine out of ten.
It is definitely a private cloud for Portkey from their provider. Using their online services with Portkey is good. If you are seeking an alternative solution for the product, Portkey is definitely worth a look. My overall review rating for this product is 7.
Portkey offers a robust digital solution catering to modern enterprises with a focus on ease of integration and comprehensive functionality, particularly for data-driven decision-making and process optimization.Portkey stands out with its highly efficient data integration capabilities, allowing seamless connectivity across multiple systems. Designed for enterprises looking to streamline operations, it facilitates real-time analytics, empowering businesses to make informed choices quickly. It...
Everything is perfect except for the documentation and the steep learning curve that I already mentioned. That is the part for which I deducted one mark. Everything else is perfect. Portkey is a very useful software if you are going forward with your AI application that uses the LLM gateway. I would recommend you use it and you will love it within a few days.
Regarding governance and security, I would say security is quite high. In fact, one of the reasons we chose to implement Portkey is that it gives us a central control point for AI usage rather than every application managing it independently. From a security perspective, I appreciate that sensitive provider credentials are managed centrally instead of being distributed across multiple services. On the governance side, having a single layer for routing, usage tracking, and policy enforcement helps us standardize how AI is used across different teams. As more applications adopt LLMs, consistency becomes increasingly valuable. Overall, I would describe Portkey as a strong differentiator that provides visibility and centralized control. Portkey is deployed in my organization as a hybrid cloud deployment. We use AWS as part of our hybrid cloud setup. Our applications and backend services run on AWS, and all AI requests are routed through Portkey before reaching the underlying models. We have backend services and API databases on AWS. Portkey centralizes routing, observability, and cost management. This approach gives us the flexibility of managing foundation models while keeping our application logic simpler. Operational controls are within our own cloud environment, allowing us to change model providers without impacting the applications. In terms of customizing, I would say Portkey is very flexible because one of the reasons we adopted it is that it fits into the existing architecture. Most of my customization has been through configuring rather than custom development. For example, I customized different routing rules for different AI workloads. I have also integrated Portkey into my internal monitoring and engineering workflows. The best part is that our application code remains largely provider-agnostic. If we want to evaluate a new LLM or change routing for a specific use case, we typically do not need to make significant changes. I have not had to build major custom extensions to make Portkey work for us. Most of what I have needed has been supported through existing configurations. Overall, customizability is highly rated. For my organization, compliance is important, though we are not heavily regulated. From my perspective, Portkey contributes to a centralized control layer. Since all LLM traffic passes through a single gateway, it is much easier. That said, we do not rely on Portkey alone to meet compliance requirements. We combine it with our own security controls. I can share some approximate figures for faster development and better cost awareness. For development, I estimate that Portkey reduced engineering efforts by around thirty to forty percent. Previously, each team had to implement provider-specific authentication, retries, logging, and error handling. For model evaluation, we have seen about fifty percent reduction in time. From a cost management perspective, we have reduced unnecessary LLM consumption by around fifteen to twenty percent. I have also noticed thirty to forty percent reduction in troubleshooting time. Overall, Portkey has had a huge business impact in terms of cost savings and operational efficiency. I would rate this review overall at nine out of ten.
It is definitely a private cloud for Portkey from their provider. Using their online services with Portkey is good. If you are seeking an alternative solution for the product, Portkey is definitely worth a look. My overall review rating for this product is 7.