What new features has Microsoft added to Copilot in its latest update?
Passionate AI News Copilot

Microsoft Enhances Copilot with Screen Analysis and Voice Interaction

Microsoft has unveiled significant updates to its Copilot AI assistant, introducing new features that expand its capabilities across various platforms. The Copilot Vision feature allows the AI to analyze and respond to queries about content displayed on a user’s screen, while Think Deeper enables more complex problem-solving. Additionally, Copilot Voice brings speech interaction to the assistant, allowing users to engage in spoken conversations. Microsoft emphasizes privacy measures in these new features, stating that processed data is not stored or used for model training. The company is also introducing personalization options to tailor Copilot’s recommendations based on user interactions and preferences.

Microsoft’s Copilot Daily: A New Era of AI-Powered News Summaries

Microsoft has introduced Copilot Daily, a feature of its AI assistant that provides spoken summaries of weather and current events. This service, initially available in the US and UK, draws content from authorized sources including Reuters, Axel Springer, Hearst Magazines, and The Financial Times. Microsoft is compensating these publishers, marking a shift in its approach to content licensing for AI products. This move comes as the AI industry grapples with copyright concerns and the need for quality training data. While the news industry faces ongoing challenges, including job losses and reduced traffic due to tech giants’ algorithms, partnerships like these could potentially offer a new revenue stream for struggling publishers.

Microsoft Unveils Bing Generative Search to Enhance User Experience

Microsoft has launched Bing Generative Search, a new AI-powered feature for its search engine. This tool uses advanced AI models to aggregate information from various web sources, providing users with comprehensive summaries in response to their queries. The feature aims to offer more than just answers, striving to understand search intent and generate relevant results dynamically. While Microsoft touts improved search capabilities, concerns have been raised about potential impacts on web traffic to source sites and the accuracy of AI-generated content. The company claims to be monitoring these effects but has not shared recent data. As Bing holds a smaller market share compared to Google, the overall impact of this feature on the search landscape remains to be seen.

OpenAI Unveils Developer-Focused Tools at DevDay 2024

OpenAI’s DevDay 2024 introduced several new tools for AI app developers, despite recent executive departures. The company launched a public beta of its Realtime API, enabling low-latency, AI-generated voice responses in applications. This feature allows for speech-to-speech experiences with six provided voices, though third-party voices are not permitted. OpenAI also announced vision fine-tuning capabilities for GPT-4o, prompt caching for cost reduction, and model distillation to improve smaller AI models’ performance. While the event showcased these advancements, it notably lacked updates on previously announced features like the GPT Store and new AI models. OpenAI continues to compete in the AI model licensing space, emphasizing its commitment to developer support and innovation.

Meta’s Ambiguity on AI Training with Smart Glasses Data Raises Privacy Concerns

Meta’s AI-powered Ray-Ban smart glasses can capture photos both intentionally and through AI-triggered features. However, the company has not provided clear answers about whether these images will be used to train AI models. This lack of transparency is particularly concerning given the new real-time video feature, which could potentially collect numerous images without users’ conscious awareness. The situation highlights the broader debate about data privacy and the use of personal information for AI training. While other AI companies have established clear policies against training on user data, Meta’s ambiguous stance on this issue raises questions about user privacy and data protection in the era of AI-integrated wearable technology.

Pinterest Enhances Advertiser Tools with Generative AI and Automation

Pinterest has introduced new generative AI features for advertisers, allowing them to transform product images with lifestyle backgrounds. This technology, part of the Pinterest Performance+ suite, aims to increase ad engagement and clickthrough rates. Early adopters like Walgreens have reported significant improvements in ad performance. The update also includes automation tools to streamline campaign creation and new Promotions features to offer user discounts. These enhancements are designed to optimize advertiser spending and improve conversion rates. Pinterest’s move follows similar initiatives by other tech giants, reflecting the growing importance of AI in digital advertising. The company is rolling out these features globally, offering advertisers more sophisticated tools to reach and engage Pinterest’s user base.

Runware Revolutionizes AI Inference with Custom Hardware and Optimized Software

Runware, a new AI inference startup, has developed a unique approach to accelerate image generation using custom-built servers and optimized software. The company’s innovative system combines specially designed hardware with advanced orchestration techniques, resulting in remarkably fast image generation times of less than a second. Unlike traditional GPU hosting services, Runware offers an image generation API with a cost-per-call fee structure, encouraging efficiency. By optimizing the entire inference pipeline, from hardware to software, Runware aims to provide faster and more cost-effective AI inference services compared to competitors. The company’s technology has the potential to support GPUs from multiple vendors, potentially addressing the current dominance of Nvidia in the AI hardware market.

Frequently asked questions

Microsoft’s latest Copilot update introduces three major features: Copilot Vision for analyzing screen content, Think Deeper for complex problem-solving, and Copilot Voice for spoken interactions. The AI assistant can now analyze what’s on your screen, engage in more sophisticated reasoning, and participate in voice conversations. Microsoft emphasizes that these features include strong privacy measures, with processed data not being stored or used for training purposes. Users can also personalize Copilot’s recommendations based on their interactions and preferences.
Microsoft Copilot Daily provides AI-powered spoken summaries of weather and news, sourcing content from authorized partners including Reuters, Axel Springer, Hearst Magazines, and The Financial Times. The service is currently available in the US and UK, with Microsoft directly compensating publishers for their content. This approach represents a new model for content licensing in AI products and potentially offers a new revenue stream for news publishers.
Bing Generative Search is Microsoft’s new AI-powered search feature that aggregates information from multiple web sources to provide comprehensive summaries in response to user queries. The system uses advanced AI models to understand search intent and generate dynamic, relevant results. While it aims to enhance the search experience, the feature has raised questions about its impact on source website traffic and content accuracy.
The main privacy concern with Meta’s AI-powered Ray-Ban smart glasses centers on the company’s unclear stance on whether images captured by the glasses will be used for AI model training. This is particularly concerning due to the glasses’ ability to capture photos both intentionally and through AI-triggered features, including real-time video recording, potentially collecting numerous images without users’ explicit awareness.
Microsoft Copilot distinguishes itself through its deep integration with Microsoft’s ecosystem and its focus on privacy and personalization. Unlike other AI assistants, Copilot can analyze screen content, engage in voice interactions, and provide news summaries through Copilot Daily. It also emphasizes user privacy by not storing processed data or using it for model training, while offering personalization options to improve user experience.
Pinterest has launched new generative AI tools that allow advertisers to transform product images by adding lifestyle backgrounds. The Pinterest Performance+ suite includes automation tools for campaign creation and new Promotions features for user discounts. Early adopters like Walgreens have reported significant improvements in ad performance, with the tools designed to increase engagement and clickthrough rates.
Runware is revolutionizing AI image generation through a combination of custom-built servers and optimized software, achieving generation times of less than a second. Their unique approach uses specially designed hardware and advanced orchestration techniques, offering an image generation API with a cost-per-call pricing model. This system aims to provide faster and more cost-effective AI inference services compared to traditional GPU hosting services.
Picture of Gor Gasparyan

Gor Gasparyan

Optimizing digital experiences for growth-stage & enterprise brands through research-driven design, automation, and AI