Be a part of our day by day and weekly newsletters for the newest updates and unique content material on industry-leading AI protection. Be taught Extra
AI is advancing at a speedy clip for companies, and that’s very true of speech and voice AI fashions.
Working example: As we speak, ElevenLabs, the well-funded voice and AI sound results startup based by former Palantir engineers, debuted Conversational AI 2.0, a major improve to its platform for constructing superior voice brokers for enterprise use circumstances, corresponding to buyer assist, name facilities, and outbound gross sales and advertising.
This replace introduces a bunch of latest options designed to create extra pure, clever, and safe interactions, making it well-suited for enterprise-level purposes.
The launch comes simply 4 months after the debut of the unique platform, reflecting ElevenLabs’ dedication to speedy growth, and a day after rival voice AI startup Hume launched its personal new, turn-based voice AI mannequin, EVI 3.
It additionally comes after new open supply AI voice fashions hit the scene, prompting some AI influencers to declare ElevenLabs lifeless. It appears these declarations have been, naturally, untimely.
Based on Jozef Marko from ElevenLabs’ engineering staff, Conversational AI 2.0 is considerably higher than its predecessor, setting a brand new normal for voice-driven experiences.
Enhancing naturalistic speech
A key spotlight of Conversational AI 2.0 is its state-of-the-art turn-taking mannequin.
This know-how is designed to deal with the nuances of human dialog, eliminating awkward pauses or interruptions that may happen in conventional voice techniques.
By analyzing conversational cues like hesitations and filler phrases in real-time, the agent can perceive when to talk and when to pay attention.
This function is especially related for purposes corresponding to customer support, the place brokers should steadiness fast responses with the pure rhythms of a dialog.
Multilingual assist
Conversational AI 2.0 additionally introduces built-in language detection, enabling seamless multilingual discussions with out the necessity for handbook configuration.
This functionality ensures that the agent can acknowledge the language spoken by the person and reply accordingly throughout the similar interplay.
The function caters to world enterprises looking for constant service for numerous buyer bases, eradicating language boundaries and fostering extra inclusive experiences.
Enterprise-grade
One of many extra highly effective additions is the built-in Retrieval-Augmented Technology (RAG) system. This function permits the AI to entry exterior information bases and retrieve related info immediately, whereas sustaining minimal latency and robust privateness protections.
For instance, in healthcare settings, this implies a medical assistant agent can pull up therapy pointers straight from an establishment’s database immediately. In buyer assist, brokers can entry up-to-date product particulars from inside documentation to help customers extra successfully.
Multimodality and alternate personas
Along with these core options, ElevenLabs’ new platform helps multimodality, which means brokers can talk through voice, textual content, or a mixture of each. This flexibility reduces the engineering burden on builders, as brokers solely have to be outlined as soon as to function throughout totally different communication channels.
Additional enhancing agent expressiveness, Conversational AI 2.0 permits multi-character mode, enabling a single agent to modify between totally different personas. This functionality may very well be priceless in eventualities corresponding to inventive content material growth, coaching simulations, or buyer engagement campaigns.
Batch outbound calling
For enterprises trying to automate large-scale outreach, the platform now helps batch calls.
Organizations can provoke a number of outbound calls concurrently utilizing Conversational AI brokers, an method well-suited for surveys, alerts, and personalised messages.
This function goals to extend each attain and operational effectivity, providing a extra scalable various to handbook outbound efforts.
Enterprise-grade requirements and pricing plans
Past the options that improve communication and engagement, Conversational AI 2.0 locations a powerful emphasis on belief and compliance. The platform is totally HIPAA-compliant, a important requirement for healthcare purposes that demand strict privateness and knowledge safety. It additionally helps non-compulsory EU knowledge residency, aligning with knowledge sovereignty necessities in Europe.
ElevenLabs reinforces these compliance-focused options with enterprise-grade safety and reliability. Designed for prime availability and integration with third-party techniques, Conversational AI 2.0 is positioned as a safe and reliable alternative for companies working in delicate or regulated environments.
So far as pricing is worried, listed below are the out there subscription plans that embody Conversational AI at the moment listed on ElevenLabs’ web site:
- Free: $0/month, consists of quarter-hour, 4 concurrency restrict, requires attribution and no business licensing.
- Starter: $5/month, consists of 50 minutes, 6 concurrency restrict.
- Creator: $11/month (discounted from $22), consists of 250 minutes, 6 concurrency restrict, ~$0.12 per further minute.
- Professional: $99/month, consists of 1,100 minutes, 10 concurrency restrict, ~$0.11 per further minute.
- Scale: $330/month, consists of 3,600 minutes, 20 concurrency restrict, ~$0.10 per further minute.
- Enterprise: $1,320/month, consists of 13,750 minutes, 30 concurrency restrict, ~$0.096 per further minute.
A brand new chapter in lifelike, naturalistic AI voice interactions
As acknowledged within the firm’s video introducing the brand new launch, “The potential of conversational AI has by no means been larger. The time to construct is now.”
With Conversational AI 2.0, ElevenLabs goals to offer the instruments and infrastructure for enterprises to create actually clever, context-aware voice brokers that elevate the usual of digital interactions.
For these concerned about studying extra, ElevenLabs encourages builders and organizations to discover its documentation, go to the developer portal, or attain out to the gross sales staff to see how Conversational AI 2.0 can improve their buyer experiences.