Bing Chat Improves Effectivity & Reduces Latency Points


Fast Happy Bing Robot

Bing Chat has made some huge effectivity enhancements and lowered latency points for some queries by 25%. Mikhail Parakhin, the CEO of Bing, stated on Twitter, “yesterday we launched a very reworked backend for interior monologue, lowering time to first token by ~25%, and, much more importantly, making latency extra steady, lowering spikes.”

He shared this chart exhibiting the discount:

click for full size

Michael Schechter from Bing added on Twitter, “These sort of modifications usually don’t make the weblog, however signify a ton of labor and a big enchancment to the general expertise.”

Lastly, it appears Bing posted about this enchancment on its weblog submit on Friday, saying, “We shipped efficiency enhancements which have lowered latency spikes for sure chat solutions.”

Discussion board dialogue at Twitter.


Leave a Reply

Your email address will not be published. Required fields are marked *