My main use case for AssemblyAI was for a voice-based calling system that we created.
A specific example of how I used AssemblyAI in my voice-based calling system is that it was used for the text-to-speech part and also speech-to-text. For speech-to-text, I don't remember if we also used something else, but for text-to-speech, we definitely relied on AssemblyAI because the voices were significantly better.
I don't have anything else to add about my use case with AssemblyAI.
The best features AssemblyAI offers include a large selection of voices and an intuitive dashboard where we could customize and tweak things according to what we needed.
When I mention customizing and tweaking things, it was a mix of all aspects, and I could also change the AI model behind it.
AssemblyAI has impacted my organization positively, not in the current organization, but in the previous organization. Because of AssemblyAI, we were able to envision something that could speak naturally to mass consumers.
That natural-sounding speech impacted our customers because users couldn't tell if it was AI, and even if they could, they could still have a natural conversation.
AssemblyAI can be improved in several areas. I don't remember if AssemblyAI had a webhook, but if they have one, that's beneficial. The biggest improvement I think was the lack of background sound. If AssemblyAI doesn't have this feature anymore, but suppose we have a use case where a customer support representative is talking to an actual customer, for it to actually sound natural, perhaps a dim office workspace background would be nice. This would give it a much more natural feel instead of a very silent background, which feels very artificial.
Regarding AssemblyAI's AI capabilities, I have no idea about its governance and security. I would really like to know if it is compliant with Saudi PDPL. A feature I would want AssemblyAI to have is to cater to the MENA region and the Middle East market. There's a law in Saudi called PDPL, Personal Data Privacy Law, and that dictates that all the data should remain within the Kingdom or within GCC and all the processing should happen there. If AssemblyAI could offer some feature or some way to ensure that the hosting is being done within maybe GCP Dammam or AWS in the GCC, or the cloud providers that reside here, and the physical data centers that are being used are of the GCC for our entire processing, that would make it so much more feasible to be used within organizations in Saudi.
Regarding AssemblyAI's AI capabilities, I can't think much about its accuracy and reliability of output because I think the AI is of a third party that is connected. I don't know if AssemblyAI has any LLM that does the reasoning. So I don't think it's fair to say it's AssemblyAI's capability.
I used AssemblyAI for one and a half years, but I haven't been using it for a year now.
I would say to others looking into using AssemblyAI that it's a good start and it's very easy. They should start by first using the dashboard and trying it out instead of jumping into integrations to see if it best fits their use case. I would rate my overall experience with AssemblyAI an 8 out of 10.